Ensemble

Dataset: wisconsin

Models

Model Narratives

anthropic37

Round ID: 202
Prompt used:
	To determine if an entity is Fylaran or Qtharri, evaluate the following classification rules:
	
	Entity is classified as Fylaran if it meets at least 3 of these primary criteria:
	1. mean_orbital_radius > 2.75
	2. mean_magnetosphere_extent > 4.55
	3. mean_atmospheric_depth > 6.50
	4. mean_tidal_distortion > 300
	5. orbital_radius_error > 0.7 OR magnetosphere_extent_error > 1.8 OR atmospheric_depth_error > 7.0
	
	Entity is classified as Qtharri if it meets at least 3 of these primary criteria:
	1. mean_orbital_radius < 2.70
	2. mean_core_density > 0.94
	3. mean_ring_system_complexity > 0.94
	4. mean_impact_crater_count > 0.97
	5. mean_tidal_distortion < 100
	
	In cases where an entity meets criteria for both categories or fails to meet 3 criteria for either category, apply the following tiebreaker rules in order:
	- If mean_orbital_radius > 2.8 AND mean_magnetosphere_extent > 4.6, classify as Fylaran
	- If mean_core_density > 0.95 AND mean_impact_crater_count > 0.98, classify as Qtharri
	- If mean_tidal_distortion > 400, classify as Fylaran
	- If mean_axial_symmetry < 50 AND mean_cloud_turbulence < 50, classify as Qtharri
	- If atmospheric_depth_error > 8.0, classify as Fylaran
	- If none of the above applies, classify based on mean_orbital_radius (> 2.7 = Fylaran, ≤ 2.7 = Qtharri)

Confusion Matrix:
                Predicted Fylaran    Predicted Qtharri   
Actual Fylaran                    29                    3
Actual Qtharri                    13                   21

Accuracy: 0.758
Precision: 0.690
Recall: 0.906
F1 Score: 0.784

Examples for Correctly predicted Fylaran: (Correct answer: Fylaran, What the previous set of rules predicted: Fylaran)
  Entity Data:
	mean_orbital_radius: 3.22882615572137
	mean_surface_roughness: 353.5
	mean_magnetosphere_extent: 5.1191907006506
	mean_atmospheric_depth: 7.47420480649612
	mean_tidal_distortion: 568.0
	mean_core_density: 0.777181938291754
	mean_ring_system_complexity: 0.700869077656294
	mean_impact_crater_count: 0.832500832500833
	mean_axial_symmetry: 565.0
	mean_cloud_turbulence: 472.5
	orbital_radius_error: 1.22841361112615
	surface_roughness_error: 1.76635217326557
	magnetosphere_extent_error: 3.1316130029108
	atmospheric_depth_error: 15.2643375224737
	tidal_distortion_error: 0.15274161188098
	core_density_error: 0.313145333671125
	ring_system_complexity_error: 0.35749125863439
	impact_crater_count_error: 0.134981480211176
	axial_symmetry_error: 0.213236957397164
	cloud_turbulence_error: 0.099373034571759
	max_orbital_radius: 3.29657733253205
	max_surface_roughness: 236.0
	max_magnetosphere_extent: 5.20345708552408
	max_atmospheric_depth: 7.63723438878947
	max_tidal_distortion: 535.0
	max_core_density: 0.702049985959
	max_ring_system_complexity: 0.632791242169208
	max_impact_crater_count: 0.816459830176355
	max_axial_symmetry: 448.0
	max_cloud_turbulence: 287.5


Examples for Falsely predicted Qtharri when it should have been Fylaran: (Correct answer: Fylaran, What the previous set of rules predicted: Qtharri)
  Entity Data:
	mean_orbital_radius: 2.62249231274056
	mean_surface_roughness: 457.0
	mean_magnetosphere_extent: 4.41546141076012
	mean_atmospheric_depth: 6.22910254457264
	mean_tidal_distortion: 207.0
	mean_core_density: 0.94552812473407
	mean_ring_system_complexity: 0.955009502344548
	mean_impact_crater_count: 0.973671911512697
	mean_axial_symmetry: 112.0
	mean_cloud_turbulence: 240.0
	orbital_radius_error: 0.486518242206806
	surface_roughness_error: 1.17473401244707
	magnetosphere_extent_error: 1.20706255016051
	atmospheric_depth_error: 4.45757781760453
	tidal_distortion_error: 0.086596766683289
	core_density_error: 0.109635760589326
	ring_system_complexity_error: 0.152708873350569
	impact_crater_count_error: 0.0944457516249408
	axial_symmetry_error: 0.128335497817245
	cloud_turbulence_error: 0.0512737749731771
	max_orbital_radius: 2.74019465442878
	max_surface_roughness: 507.0
	max_magnetosphere_extent: 4.53302950821041
	max_atmospheric_depth: 6.48402436206708
	max_tidal_distortion: 393.0
	max_core_density: 0.867829558274755
	max_ring_system_complexity: 0.821220333415455
	max_impact_crater_count: 0.914653666389222
	max_axial_symmetry: 291.5
	max_cloud_turbulence: 297.0


Examples for Falsely predicted Fylaran when it should have been Qtharri: (Correct answer: Qtharri, What the previous set of rules predicted: Fylaran)
  Entity Data:
	mean_orbital_radius: 2.63547950826737
	mean_surface_roughness: 135.5
	mean_magnetosphere_extent: 4.43248207816237
	mean_atmospheric_depth: 6.24358420665871
	mean_tidal_distortion: 360.5
	mean_core_density: 0.926414867105787
	mean_ring_system_complexity: 0.942018746173049
	mean_impact_crater_count: 0.967398664989842
	mean_axial_symmetry: 239.0
	mean_cloud_turbulence: 390.0
	orbital_radius_error: 0.457602447545902
	surface_roughness_error: 0.873842090998139
	magnetosphere_extent_error: 1.10950439386241
	atmospheric_depth_error: 4.20356991139674
	tidal_distortion_error: 0.093407708461347
	core_density_error: 0.141527382509534
	ring_system_complexity_error: 0.152807067899361
	impact_crater_count_error: 0.106395488626163
	axial_symmetry_error: 0.162018517460196
	cloud_turbulence_error: 0.0687459089691888
	max_orbital_radius: 2.69056488676119
	max_surface_roughness: 111.0
	max_magnetosphere_extent: 4.49769632768286
	max_atmospheric_depth: 6.37400215057244
	max_tidal_distortion: 443.5
	max_core_density: 0.828637719588996
	max_ring_system_complexity: 0.816926721673066
	max_impact_crater_count: 0.904486251808973
	max_axial_symmetry: 482.0
	max_cloud_turbulence: 454.0


Examples for Correctly predicted Qtharri: (Correct answer: Qtharri, What the previous set of rules predicted: Qtharri)
  Entity Data:
	mean_orbital_radius: 2.64119789411437
	mean_surface_roughness: 260.0
	mean_magnetosphere_extent: 4.42616313016197
	mean_atmospheric_depth: 6.26301723762988
	mean_tidal_distortion: 196.5
	mean_core_density: 0.963706801842607
	mean_ring_system_complexity: 0.975019987909752
	mean_impact_crater_count: 0.971600128251217
	mean_axial_symmetry: 45.0
	mean_cloud_turbulence: 161.0
	orbital_radius_error: 0.428835632847831
	surface_roughness_error: 1.5303594349041
	magnetosphere_extent_error: 1.0816653826392
	atmospheric_depth_error: 3.76297754444536
	tidal_distortion_error: 0.0659696900098826
	core_density_error: 0.0699928567783885
	ring_system_complexity_error: 0.115887876846545
	impact_crater_count_error: 0.107888831674089
	axial_symmetry_error: 0.163431943022164
	cloud_turbulence_error: 0.042154477816716
	max_orbital_radius: 2.66025953726586
	max_surface_roughness: 197.0
	max_magnetosphere_extent: 4.44804843021588
	max_atmospheric_depth: 6.30426597035273
	max_tidal_distortion: 31.0
	max_core_density: 0.955849319913209
	max_ring_system_complexity: 0.953898104604466
	max_impact_crater_count: 0.952263053145801
	max_axial_symmetry: 18.0
	max_cloud_turbulence: 25.0


gemini25

Round ID: 125
Prompt used:
	Predict the classification based on the following rules. Use the first rule that matches:
	
	1. If mean_atmospheric_depth >= 6.7 AND mean_surface_roughness >= 200, predict Fylaran.
	2. Else if max_atmospheric_depth >= 7.0 AND mean_surface_roughness >= 100, predict Fylaran.
	3. Else if mean_core_density >= 0.92 AND mean_atmospheric_depth < 6.2, predict Qtharri.
	4. Else if max_atmospheric_depth >= 6.8 AND mean_surface_roughness >= 100, predict Fylaran.
	5. Else if mean_atmospheric_depth >= 6.2 AND mean_surface_roughness >= 400 AND mean_core_density < 0.92, predict Fylaran.
	6. Else (if none of the above conditions is met), predict Qtharri.
	
	Classification:
	

Confusion Matrix:
                Predicted Fylaran    Predicted Qtharri   
Actual Fylaran                    26                    6
Actual Qtharri                     1                   33

Accuracy: 0.894
Precision: 0.963
Recall: 0.812
F1 Score: 0.881

Examples for Correctly predicted Fylaran: (Correct answer: Fylaran, What the previous set of rules predicted: Fylaran)
  Entity Data:
	mean_orbital_radius: 3.11839228628988
	mean_surface_roughness: 449.0
	mean_magnetosphere_extent: 4.97948856509942
	mean_atmospheric_depth: 7.24992553671799
	mean_tidal_distortion: 528.5
	mean_core_density: 0.827335153470671
	mean_ring_system_complexity: 0.78064012490242
	mean_impact_crater_count: 0.864902266043937
	mean_axial_symmetry: 517.0
	mean_cloud_turbulence: 424.0
	orbital_radius_error: 0.790063288604147
	surface_roughness_error: 0.959635347410671
	magnetosphere_extent_error: 2.03911745615597
	atmospheric_depth_error: 8.99944442729661
	tidal_distortion_error: 0.0722149568995232
	core_density_error: 0.193028495305745
	ring_system_complexity_error: 0.217209576216151
	impact_crater_count_error: 0.113490087672889
	axial_symmetry_error: 0.143003496460751
	cloud_turbulence_error: 0.0634665266104897
	max_orbital_radius: 3.30431930668567
	max_surface_roughness: 405.0
	max_magnetosphere_extent: 5.15329159449778
	max_atmospheric_depth: 7.64108424917491
	max_tidal_distortion: 456.0
	max_core_density: 0.636253737990711
	max_ring_system_complexity: 0.586407083797572
	max_impact_crater_count: 0.805023345677025
	max_axial_symmetry: 532.0
	max_cloud_turbulence: 481.0


Examples for Falsely predicted Qtharri when it should have been Fylaran: (Correct answer: Fylaran, What the previous set of rules predicted: Qtharri)
  Entity Data:
	mean_orbital_radius: 2.59897910604785
	mean_surface_roughness: 120.0
	mean_magnetosphere_extent: 4.42568460401334
	mean_atmospheric_depth: 6.16981991563206
	mean_tidal_distortion: 559.0
	mean_core_density: 0.854700854700855
	mean_ring_system_complexity: 0.863707030575229
	mean_impact_crater_count: 0.925163522652629
	mean_axial_symmetry: 487.0
	mean_cloud_turbulence: 541.0
	orbital_radius_error: 0.57835974963685
	surface_roughness_error: 0.943504107039286
	magnetosphere_extent_error: 1.48895936814945
	atmospheric_depth_error: 5.21440312979348
	tidal_distortion_error: 0.0866602561731732
	core_density_error: 0.182893411581719
	ring_system_complexity_error: 0.191624633072056
	impact_crater_count_error: 0.106630202100531
	axial_symmetry_error: 0.147139389695622
	cloud_turbulence_error: 0.0712881476824865
	max_orbital_radius: 2.80154054418955
	max_surface_roughness: 232.0
	max_magnetosphere_extent: 4.64822967544854
	max_atmospheric_depth: 6.61015754174298
	max_tidal_distortion: 553.0
	max_core_density: 0.655780706931602
	max_ring_system_complexity: 0.651253663301856
	max_impact_crater_count: 0.851716208159441
	max_axial_symmetry: 536.0
	max_cloud_turbulence: 549.0


Examples for Falsely predicted Fylaran when it should have been Qtharri: (Correct answer: Qtharri, What the previous set of rules predicted: Fylaran)
  Entity Data:
	mean_orbital_radius: 2.73890266458497
	mean_surface_roughness: 512.0
	mean_magnetosphere_extent: 4.57275029473198
	mean_atmospheric_depth: 6.48829266123012
	mean_tidal_distortion: 177.0
	mean_core_density: 0.890471950133571
	mean_ring_system_complexity: 0.908347715505496
	mean_impact_crater_count: 0.962556550197324
	mean_axial_symmetry: 354.5
	mean_cloud_turbulence: 355.0
	orbital_radius_error: 0.504182506638221
	surface_roughness_error: 1.03874924789383
	magnetosphere_extent_error: 1.61709616287962
	atmospheric_depth_error: 4.80728613668877
	tidal_distortion_error: 0.0844866853415377
	core_density_error: 0.215708136146971
	ring_system_complexity_error: 0.195678307433399
	impact_crater_count_error: 0.107796103825695
	axial_symmetry_error: 0.14380542409798
	cloud_turbulence_error: 0.0781728853247723
	max_orbital_radius: 2.84607149899958
	max_surface_roughness: 478.0
	max_magnetosphere_extent: 4.74057482299429
	max_atmospheric_depth: 6.69691078325494
	max_tidal_distortion: 304.0
	max_core_density: 0.704126179411351
	max_ring_system_complexity: 0.712250712250712
	max_impact_crater_count: 0.892458723784025
	max_axial_symmetry: 429.5
	max_cloud_turbulence: 490.5


Examples for Correctly predicted Qtharri: (Correct answer: Qtharri, What the previous set of rules predicted: Qtharri)
  Entity Data:
	mean_orbital_radius: 2.52011290552262
	mean_surface_roughness: 198.5
	mean_magnetosphere_extent: 4.31294447348644
	mean_atmospheric_depth: 5.98896141688986
	mean_tidal_distortion: 474.5
	mean_core_density: 0.913358785598159
	mean_ring_system_complexity: 0.980094285070224
	mean_impact_crater_count: 0.981730004614131
	mean_axial_symmetry: 165.0
	mean_cloud_turbulence: 410.0
	orbital_radius_error: 0.533197899470731
	surface_roughness_error: 1.38130373198656
	magnetosphere_extent_error: 1.39176147381654
	atmospheric_depth_error: 4.62385120867876
	tidal_distortion_error: 0.0816333265278342
	core_density_error: 0.131719398723195
	ring_system_complexity_error: 0.107610408418517
	impact_crater_count_error: 0.0975704873412037
	axial_symmetry_error: 0.151062900806254
	cloud_turbulence_error: 0.0593801313572141
	max_orbital_radius: 2.62321826558551
	max_surface_roughness: 342.0
	max_magnetosphere_extent: 4.42676096601405
	max_atmospheric_depth: 6.22257626807137
	max_tidal_distortion: 380.5
	max_core_density: 0.848032564450475
	max_ring_system_complexity: 0.928436142162142
	max_impact_crater_count: 0.939831958045901
	max_axial_symmetry: 179.0
	max_cloud_turbulence: 301.0


opus40

Round ID: 245
Prompt used:
	Classify the entity as either Fylaran or Qtharri based on the following rules:
	
	1. If mean_impact_crater_count >= 0.980, classify as Qtharri
	
	2. If mean_impact_crater_count >= 0.965 and mean_impact_crater_count < 0.980:
	   - If mean_surface_roughness < 200, classify as Qtharri
	   - If mean_surface_roughness >= 400, classify as Fylaran
	   - Otherwise, if mean_orbital_radius >= 2.85, classify as Fylaran
	   - Otherwise, classify as Qtharri
	
	3. If mean_impact_crater_count < 0.935, classify as Fylaran
	
	4. If mean_impact_crater_count >= 0.935 and mean_impact_crater_count < 0.965:
	   - If mean_surface_roughness < 150, classify as Qtharri
	   - If mean_ring_system_complexity >= 0.965, classify as Qtharri
	   - If mean_ring_system_complexity < 0.915, classify as Fylaran
	   - If mean_ring_system_complexity >= 0.915 and mean_ring_system_complexity < 0.965:
	     * If mean_orbital_radius < 2.65, classify as Qtharri
	     * If mean_orbital_radius >= 2.82, classify as Fylaran
	     * If mean_orbital_radius >= 2.65 and mean_orbital_radius < 2.82:
	       - If mean_surface_roughness < 250, classify as Qtharri
	       - If mean_core_density >= 0.915, classify as Qtharri
	       - Otherwise, classify as Fylaran
	
	Apply these rules in order and stop at the first classification decision.

Confusion Matrix:
                Predicted Fylaran    Predicted Qtharri   
Actual Fylaran                    30                    2
Actual Qtharri                     5                   29

Accuracy: 0.894
Precision: 0.857
Recall: 0.938
F1 Score: 0.896

Examples for Correctly predicted Fylaran: (Correct answer: Fylaran, What the previous set of rules predicted: Fylaran)
  Entity Data:
	mean_orbital_radius: 3.02916704964023
	mean_surface_roughness: 422.5
	mean_magnetosphere_extent: 4.87443367291585
	mean_atmospheric_depth: 7.08590146436561
	mean_tidal_distortion: 318.0
	mean_core_density: 0.881911985183879
	mean_ring_system_complexity: 0.842957093483942
	mean_impact_crater_count: 0.900657479960371
	mean_axial_symmetry: 483.5
	mean_cloud_turbulence: 126.5
	orbital_radius_error: 0.789050061783155
	surface_roughness_error: 1.511290838985
	magnetosphere_extent_error: 2.27442300375282
	atmospheric_depth_error: 8.22556988907152
	tidal_distortion_error: 0.0689637585982667
	core_density_error: 0.183521115951271
	ring_system_complexity_error: 0.208446635856758
	impact_crater_count_error: 0.134387499418659
	axial_symmetry_error: 0.19380402472601
	cloud_turbulence_error: 0.0573410847473258
	max_orbital_radius: 3.16758253048065
	max_surface_roughness: 526.0
	max_magnetosphere_extent: 5.06638530920075
	max_atmospheric_depth: 7.34018683532012
	max_tidal_distortion: 184.0
	max_core_density: 0.743052459503641
	max_ring_system_complexity: 0.678702321161938
	max_impact_crater_count: 0.815993472052224
	max_axial_symmetry: 539.0
	max_cloud_turbulence: 271.5


Examples for Falsely predicted Qtharri when it should have been Fylaran: (Correct answer: Fylaran, What the previous set of rules predicted: Qtharri)
  Entity Data:
	mean_orbital_radius: 2.69462718077007
	mean_surface_roughness: 125.5
	mean_magnetosphere_extent: 4.51557365217633
	mean_atmospheric_depth: 6.37178277279419
	mean_tidal_distortion: 366.0
	mean_core_density: 0.886524822695035
	mean_ring_system_complexity: 0.927738451975619
	mean_impact_crater_count: 0.951755513043809
	mean_axial_symmetry: 177.0
	mean_cloud_turbulence: 411.0
	orbital_radius_error: 0.52792044855262
	surface_roughness_error: 0.787718223732319
	magnetosphere_extent_error: 1.39892816112908
	atmospheric_depth_error: 4.83218377133983
	tidal_distortion_error: 0.0686804193347711
	core_density_error: 0.143701078631999
	ring_system_complexity_error: 0.132627297341083
	impact_crater_count_error: 0.0959479025304879
	axial_symmetry_error: 0.110453610171873
	cloud_turbulence_error: 0.0559464029227975
	max_orbital_radius: 2.86619290219901
	max_surface_roughness: 136.0
	max_magnetosphere_extent: 4.7122292582815
	max_atmospheric_depth: 6.70122299347312
	max_tidal_distortion: 377.5
	max_core_density: 0.738443361394181
	max_ring_system_complexity: 0.782533844588778
	max_impact_crater_count: 0.878503030835456
	max_axial_symmetry: 180.0
	max_cloud_turbulence: 495.5


Examples for Falsely predicted Fylaran when it should have been Qtharri: (Correct answer: Qtharri, What the previous set of rules predicted: Fylaran)
  Entity Data:
	mean_orbital_radius: 2.36799823154228
	mean_surface_roughness: 32.0
	mean_magnetosphere_extent: 4.17623172169429
	mean_atmospheric_depth: 5.61130162186204
	mean_tidal_distortion: 556.0
	mean_core_density: 0.819403474270731
	mean_ring_system_complexity: 0.893814801573114
	mean_impact_crater_count: 0.934247650367159
	mean_axial_symmetry: 475.0
	mean_cloud_turbulence: 568.0
	orbital_radius_error: 0.523832034148352
	surface_roughness_error: 1.17898261225516
	magnetosphere_extent_error: 1.33678719323608
	atmospheric_depth_error: 4.20356991139674
	tidal_distortion_error: 0.147546602807384
	core_density_error: 0.221088217686968
	ring_system_complexity_error: 0.227793766376519
	impact_crater_count_error: 0.120415945787923
	axial_symmetry_error: 0.162234398325386
	cloud_turbulence_error: 0.107144761887831
	max_orbital_radius: 2.45100509811232
	max_surface_roughness: 63.0
	max_magnetosphere_extent: 4.25518708733893
	max_atmospheric_depth: 5.79636165594929
	max_tidal_distortion: 566.0
	max_core_density: 0.731903681475518
	max_ring_system_complexity: 0.774413381863238
	max_impact_crater_count: 0.90293453724605
	max_axial_symmetry: 301.0
	max_cloud_turbulence: 560.0


Examples for Correctly predicted Qtharri: (Correct answer: Qtharri, What the previous set of rules predicted: Qtharri)
  Entity Data:
	mean_orbital_radius: 2.53369681395743
	mean_surface_roughness: 500.5
	mean_magnetosphere_extent: 4.32055008757213
	mean_atmospheric_depth: 6.03595978699453
	mean_tidal_distortion: 28.0
	mean_core_density: 0.946181212625842
	mean_ring_system_complexity: 0.980642124463098
	mean_impact_crater_count: 0.987040162664219
	mean_axial_symmetry: 406.5
	mean_cloud_turbulence: 168.0
	orbital_radius_error: 0.501198563445667
	surface_roughness_error: 1.33641310978305
	magnetosphere_extent_error: 1.40035709731482
	atmospheric_depth_error: 4.26731765867037
	tidal_distortion_error: 0.0782432105680742
	core_density_error: 0.152872495891184
	ring_system_complexity_error: 0.12633289357883
	impact_crater_count_error: 0.0836540495134575
	axial_symmetry_error: 0.178717654416121
	cloud_turbulence_error: 0.047021271782035
	max_orbital_radius: 2.598235335095
	max_surface_roughness: 471.0
	max_magnetosphere_extent: 4.4114640703275
	max_atmospheric_depth: 6.16856415992078
	max_tidal_distortion: 29.0
	max_core_density: 0.880204207376111
	max_ring_system_complexity: 0.932496573075094
	max_impact_crater_count: 0.954061918618518
	max_axial_symmetry: 453.0
	max_cloud_turbulence: 77.0


Ensemble Confusion Matrix

Predicted +Predicted -
Actual +293
Actual -331

Accuracy 0.909, Precision 0.906, Recall 0.906, F1 0.906