Ensemble

Dataset: wisconsin

Models

Model Narratives

anthropic37

Round ID: 202
Prompt used:
	To determine if an entity is Fylaran or Qtharri, evaluate the following classification rules:
	
	Entity is classified as Fylaran if it meets at least 3 of these primary criteria:
	1. mean_orbital_radius > 2.75
	2. mean_magnetosphere_extent > 4.55
	3. mean_atmospheric_depth > 6.50
	4. mean_tidal_distortion > 300
	5. orbital_radius_error > 0.7 OR magnetosphere_extent_error > 1.8 OR atmospheric_depth_error > 7.0
	
	Entity is classified as Qtharri if it meets at least 3 of these primary criteria:
	1. mean_orbital_radius < 2.70
	2. mean_core_density > 0.94
	3. mean_ring_system_complexity > 0.94
	4. mean_impact_crater_count > 0.97
	5. mean_tidal_distortion < 100
	
	In cases where an entity meets criteria for both categories or fails to meet 3 criteria for either category, apply the following tiebreaker rules in order:
	- If mean_orbital_radius > 2.8 AND mean_magnetosphere_extent > 4.6, classify as Fylaran
	- If mean_core_density > 0.95 AND mean_impact_crater_count > 0.98, classify as Qtharri
	- If mean_tidal_distortion > 400, classify as Fylaran
	- If mean_axial_symmetry < 50 AND mean_cloud_turbulence < 50, classify as Qtharri
	- If atmospheric_depth_error > 8.0, classify as Fylaran
	- If none of the above applies, classify based on mean_orbital_radius (> 2.7 = Fylaran, ≤ 2.7 = Qtharri)

Confusion Matrix:
                Predicted Fylaran    Predicted Qtharri   
Actual Fylaran                    29                    3
Actual Qtharri                    13                   21

Accuracy: 0.758
Precision: 0.690
Recall: 0.906
F1 Score: 0.784

Examples for Correctly predicted Fylaran: (Correct answer: Fylaran, What the previous set of rules predicted: Fylaran)
  Entity Data:
	mean_orbital_radius: 2.83732253680635
	mean_surface_roughness: 326.5
	mean_magnetosphere_extent: 4.65491227788291
	mean_atmospheric_depth: 6.7077177163824
	mean_tidal_distortion: 226.0
	mean_core_density: 0.922305024717775
	mean_ring_system_complexity: 0.911004017527717
	mean_impact_crater_count: 0.937752020855605
	mean_axial_symmetry: 290.0
	mean_cloud_turbulence: 28.5
	orbital_radius_error: 0.864522989862039
	surface_roughness_error: 1.00796825346833
	magnetosphere_extent_error: 2.24254319913798
	atmospheric_depth_error: 8.90224690738243
	tidal_distortion_error: 0.104019228991567
	core_density_error: 0.14842506526864
	ring_system_complexity_error: 0.187082869338697
	impact_crater_count_error: 0.134499070628759
	axial_symmetry_error: 0.124498995979887
	cloud_turbulence_error: 0.0441361529814278
	max_orbital_radius: 3.03350963788802
	max_surface_roughness: 253.0
	max_magnetosphere_extent: 4.86599480426999
	max_atmospheric_depth: 7.10987946307227
	max_tidal_distortion: 454.5
	max_core_density: 0.8302200083022
	max_ring_system_complexity: 0.779483981604178
	max_impact_crater_count: 0.868055555555556
	max_axial_symmetry: 204.0
	max_cloud_turbulence: 38.0


Examples for Falsely predicted Qtharri when it should have been Fylaran: (Correct answer: Fylaran, What the previous set of rules predicted: Qtharri)
  Entity Data:
	mean_orbital_radius: 2.69462718077007
	mean_surface_roughness: 125.5
	mean_magnetosphere_extent: 4.51557365217633
	mean_atmospheric_depth: 6.37178277279419
	mean_tidal_distortion: 366.0
	mean_core_density: 0.886524822695035
	mean_ring_system_complexity: 0.927738451975619
	mean_impact_crater_count: 0.951755513043809
	mean_axial_symmetry: 177.0
	mean_cloud_turbulence: 411.0
	orbital_radius_error: 0.52792044855262
	surface_roughness_error: 0.787718223732319
	magnetosphere_extent_error: 1.39892816112908
	atmospheric_depth_error: 4.83218377133983
	tidal_distortion_error: 0.0686804193347711
	core_density_error: 0.143701078631999
	ring_system_complexity_error: 0.132627297341083
	impact_crater_count_error: 0.0959479025304879
	axial_symmetry_error: 0.110453610171873
	cloud_turbulence_error: 0.0559464029227975
	max_orbital_radius: 2.86619290219901
	max_surface_roughness: 136.0
	max_magnetosphere_extent: 4.7122292582815
	max_atmospheric_depth: 6.70122299347312
	max_tidal_distortion: 377.5
	max_core_density: 0.738443361394181
	max_ring_system_complexity: 0.782533844588778
	max_impact_crater_count: 0.878503030835456
	max_axial_symmetry: 180.0
	max_cloud_turbulence: 495.5


Examples for Falsely predicted Fylaran when it should have been Qtharri: (Correct answer: Qtharri, What the previous set of rules predicted: Fylaran)
  Entity Data:
	mean_orbital_radius: 2.76945882923085
	mean_surface_roughness: 280.5
	mean_magnetosphere_extent: 4.59350238112041
	mean_atmospheric_depth: 6.53741597284935
	mean_tidal_distortion: 79.0
	mean_core_density: 0.895495656846064
	mean_ring_system_complexity: 0.917010545621275
	mean_impact_crater_count: 0.965605144744211
	mean_axial_symmetry: 254.0
	mean_cloud_turbulence: 396.0
	orbital_radius_error: 0.649615270756469
	surface_roughness_error: 1.38166566143912
	magnetosphere_extent_error: 1.80859061149836
	atmospheric_depth_error: 6.27933117457584
	tidal_distortion_error: 0.0760920495189872
	core_density_error: 0.220839308095275
	ring_system_complexity_error: 0.230282435283284
	impact_crater_count_error: 0.123571841452655
	axial_symmetry_error: 0.183193886360872
	cloud_turbulence_error: 0.0967884290605029
	max_orbital_radius: 2.84781214347737
	max_surface_roughness: 289.5
	max_magnetosphere_extent: 4.68305672464516
	max_atmospheric_depth: 6.69789807199366
	max_tidal_distortion: 39.0
	max_core_density: 0.798658254133056
	max_ring_system_complexity: 0.8
	max_impact_crater_count: 0.922466675891333
	max_axial_symmetry: 305.0
	max_cloud_turbulence: 431.0


Examples for Correctly predicted Qtharri: (Correct answer: Qtharri, What the previous set of rules predicted: Qtharri)
  Entity Data:
	mean_orbital_radius: 2.53369681395743
	mean_surface_roughness: 500.5
	mean_magnetosphere_extent: 4.32055008757213
	mean_atmospheric_depth: 6.03595978699453
	mean_tidal_distortion: 28.0
	mean_core_density: 0.946181212625842
	mean_ring_system_complexity: 0.980642124463098
	mean_impact_crater_count: 0.987040162664219
	mean_axial_symmetry: 406.5
	mean_cloud_turbulence: 168.0
	orbital_radius_error: 0.501198563445667
	surface_roughness_error: 1.33641310978305
	magnetosphere_extent_error: 1.40035709731482
	atmospheric_depth_error: 4.26731765867037
	tidal_distortion_error: 0.0782432105680742
	core_density_error: 0.152872495891184
	ring_system_complexity_error: 0.12633289357883
	impact_crater_count_error: 0.0836540495134575
	axial_symmetry_error: 0.178717654416121
	cloud_turbulence_error: 0.047021271782035
	max_orbital_radius: 2.598235335095
	max_surface_roughness: 471.0
	max_magnetosphere_extent: 4.4114640703275
	max_atmospheric_depth: 6.16856415992078
	max_tidal_distortion: 29.0
	max_core_density: 0.880204207376111
	max_ring_system_complexity: 0.932496573075094
	max_impact_crater_count: 0.954061918618518
	max_axial_symmetry: 453.0
	max_cloud_turbulence: 77.0


gemini25

Round ID: 125
Prompt used:
	Predict the classification based on the following rules. Use the first rule that matches:
	
	1. If mean_atmospheric_depth >= 6.7 AND mean_surface_roughness >= 200, predict Fylaran.
	2. Else if max_atmospheric_depth >= 7.0 AND mean_surface_roughness >= 100, predict Fylaran.
	3. Else if mean_core_density >= 0.92 AND mean_atmospheric_depth < 6.2, predict Qtharri.
	4. Else if max_atmospheric_depth >= 6.8 AND mean_surface_roughness >= 100, predict Fylaran.
	5. Else if mean_atmospheric_depth >= 6.2 AND mean_surface_roughness >= 400 AND mean_core_density < 0.92, predict Fylaran.
	6. Else (if none of the above conditions is met), predict Qtharri.
	
	Classification:
	

Confusion Matrix:
                Predicted Fylaran    Predicted Qtharri   
Actual Fylaran                    26                    6
Actual Qtharri                     1                   33

Accuracy: 0.894
Precision: 0.963
Recall: 0.812
F1 Score: 0.881

Examples for Correctly predicted Fylaran: (Correct answer: Fylaran, What the previous set of rules predicted: Fylaran)
  Entity Data:
	mean_orbital_radius: 3.0568273729138
	mean_surface_roughness: 467.0
	mean_magnetosphere_extent: 4.89335213348152
	mean_atmospheric_depth: 7.14282740116162
	mean_tidal_distortion: 215.0
	mean_core_density: 0.883938831432865
	mean_ring_system_complexity: 0.872219799389446
	mean_impact_crater_count: 0.920107100466494
	mean_axial_symmetry: 491.0
	mean_cloud_turbulence: 93.5
	orbital_radius_error: 0.870402205879558
	surface_roughness_error: 1.22841361112615
	magnetosphere_extent_error: 2.13401030925345
	atmospheric_depth_error: 9.37389993545909
	tidal_distortion_error: 0.0775628777186613
	core_density_error: 0.186601178988773
	ring_system_complexity_error: 0.205718253929981
	impact_crater_count_error: 0.112649900133112
	axial_symmetry_error: 0.1630030674558
	cloud_turbulence_error: 0.0664153596692813
	max_orbital_radius: 3.22763733053677
	max_surface_roughness: 470.0
	max_magnetosphere_extent: 5.05688254526158
	max_atmospheric_depth: 7.46794233228585
	max_tidal_distortion: 158.5
	max_core_density: 0.738606987222099
	max_ring_system_complexity: 0.709320470988793
	max_impact_crater_count: 0.86408018664132
	max_axial_symmetry: 522.0
	max_cloud_turbulence: 347.5


Examples for Falsely predicted Qtharri when it should have been Fylaran: (Correct answer: Fylaran, What the previous set of rules predicted: Qtharri)
  Entity Data:
	mean_orbital_radius: 2.62249231274056
	mean_surface_roughness: 457.0
	mean_magnetosphere_extent: 4.41546141076012
	mean_atmospheric_depth: 6.22910254457264
	mean_tidal_distortion: 207.0
	mean_core_density: 0.94552812473407
	mean_ring_system_complexity: 0.955009502344548
	mean_impact_crater_count: 0.973671911512697
	mean_axial_symmetry: 112.0
	mean_cloud_turbulence: 240.0
	orbital_radius_error: 0.486518242206806
	surface_roughness_error: 1.17473401244707
	magnetosphere_extent_error: 1.20706255016051
	atmospheric_depth_error: 4.45757781760453
	tidal_distortion_error: 0.086596766683289
	core_density_error: 0.109635760589326
	ring_system_complexity_error: 0.152708873350569
	impact_crater_count_error: 0.0944457516249408
	axial_symmetry_error: 0.128335497817245
	cloud_turbulence_error: 0.0512737749731771
	max_orbital_radius: 2.74019465442878
	max_surface_roughness: 507.0
	max_magnetosphere_extent: 4.53302950821041
	max_atmospheric_depth: 6.48402436206708
	max_tidal_distortion: 393.0
	max_core_density: 0.867829558274755
	max_ring_system_complexity: 0.821220333415455
	max_impact_crater_count: 0.914653666389222
	max_axial_symmetry: 291.5
	max_cloud_turbulence: 297.0


Examples for Falsely predicted Fylaran when it should have been Qtharri: (Correct answer: Qtharri, What the previous set of rules predicted: Fylaran)
  Entity Data:
	mean_orbital_radius: 2.73890266458497
	mean_surface_roughness: 512.0
	mean_magnetosphere_extent: 4.57275029473198
	mean_atmospheric_depth: 6.48829266123012
	mean_tidal_distortion: 177.0
	mean_core_density: 0.890471950133571
	mean_ring_system_complexity: 0.908347715505496
	mean_impact_crater_count: 0.962556550197324
	mean_axial_symmetry: 354.5
	mean_cloud_turbulence: 355.0
	orbital_radius_error: 0.504182506638221
	surface_roughness_error: 1.03874924789383
	magnetosphere_extent_error: 1.61709616287962
	atmospheric_depth_error: 4.80728613668877
	tidal_distortion_error: 0.0844866853415377
	core_density_error: 0.215708136146971
	ring_system_complexity_error: 0.195678307433399
	impact_crater_count_error: 0.107796103825695
	axial_symmetry_error: 0.14380542409798
	cloud_turbulence_error: 0.0781728853247723
	max_orbital_radius: 2.84607149899958
	max_surface_roughness: 478.0
	max_magnetosphere_extent: 4.74057482299429
	max_atmospheric_depth: 6.69691078325494
	max_tidal_distortion: 304.0
	max_core_density: 0.704126179411351
	max_ring_system_complexity: 0.712250712250712
	max_impact_crater_count: 0.892458723784025
	max_axial_symmetry: 429.5
	max_cloud_turbulence: 490.5


Examples for Correctly predicted Qtharri: (Correct answer: Qtharri, What the previous set of rules predicted: Qtharri)
  Entity Data:
	mean_orbital_radius: 2.68375750853317
	mean_surface_roughness: 112.0
	mean_magnetosphere_extent: 4.48164569970259
	mean_atmospheric_depth: 6.35662835844262
	mean_tidal_distortion: 258.0
	mean_core_density: 0.937822376441902
	mean_ring_system_complexity: 0.955064228069338
	mean_impact_crater_count: 0.964031967300036
	mean_axial_symmetry: 222.5
	mean_cloud_turbulence: 99.0
	orbital_radius_error: 0.56938563381947
	surface_roughness_error: 0.813142054010245
	magnetosphere_extent_error: 1.41279864099595
	atmospheric_depth_error: 5.21440312979348
	tidal_distortion_error: 0.0804363102087608
	core_density_error: 0.111713920350152
	ring_system_complexity_error: 0.134536240470737
	impact_crater_count_error: 0.105023806824929
	axial_symmetry_error: 0.137767920794356
	cloud_turbulence_error: 0.0423556371690947
	max_orbital_radius: 2.76316950032329
	max_surface_roughness: 80.0
	max_magnetosphere_extent: 4.55503411649429
	max_atmospheric_depth: 6.52854254201804
	max_tidal_distortion: 243.5
	max_core_density: 0.885661146045523
	max_ring_system_complexity: 0.867077083152692
	max_impact_crater_count: 0.915566460969402
	max_axial_symmetry: 155.5
	max_cloud_turbulence: 50.0


opus40

Round ID: 245
Prompt used:
	Classify the entity as either Fylaran or Qtharri based on the following rules:
	
	1. If mean_impact_crater_count >= 0.980, classify as Qtharri
	
	2. If mean_impact_crater_count >= 0.965 and mean_impact_crater_count < 0.980:
	   - If mean_surface_roughness < 200, classify as Qtharri
	   - If mean_surface_roughness >= 400, classify as Fylaran
	   - Otherwise, if mean_orbital_radius >= 2.85, classify as Fylaran
	   - Otherwise, classify as Qtharri
	
	3. If mean_impact_crater_count < 0.935, classify as Fylaran
	
	4. If mean_impact_crater_count >= 0.935 and mean_impact_crater_count < 0.965:
	   - If mean_surface_roughness < 150, classify as Qtharri
	   - If mean_ring_system_complexity >= 0.965, classify as Qtharri
	   - If mean_ring_system_complexity < 0.915, classify as Fylaran
	   - If mean_ring_system_complexity >= 0.915 and mean_ring_system_complexity < 0.965:
	     * If mean_orbital_radius < 2.65, classify as Qtharri
	     * If mean_orbital_radius >= 2.82, classify as Fylaran
	     * If mean_orbital_radius >= 2.65 and mean_orbital_radius < 2.82:
	       - If mean_surface_roughness < 250, classify as Qtharri
	       - If mean_core_density >= 0.915, classify as Qtharri
	       - Otherwise, classify as Fylaran
	
	Apply these rules in order and stop at the first classification decision.

Confusion Matrix:
                Predicted Fylaran    Predicted Qtharri   
Actual Fylaran                    30                    2
Actual Qtharri                     5                   29

Accuracy: 0.894
Precision: 0.857
Recall: 0.938
F1 Score: 0.896

Examples for Correctly predicted Fylaran: (Correct answer: Fylaran, What the previous set of rules predicted: Fylaran)
  Entity Data:
	mean_orbital_radius: 3.0568273729138
	mean_surface_roughness: 467.0
	mean_magnetosphere_extent: 4.89335213348152
	mean_atmospheric_depth: 7.14282740116162
	mean_tidal_distortion: 215.0
	mean_core_density: 0.883938831432865
	mean_ring_system_complexity: 0.872219799389446
	mean_impact_crater_count: 0.920107100466494
	mean_axial_symmetry: 491.0
	mean_cloud_turbulence: 93.5
	orbital_radius_error: 0.870402205879558
	surface_roughness_error: 1.22841361112615
	magnetosphere_extent_error: 2.13401030925345
	atmospheric_depth_error: 9.37389993545909
	tidal_distortion_error: 0.0775628777186613
	core_density_error: 0.186601178988773
	ring_system_complexity_error: 0.205718253929981
	impact_crater_count_error: 0.112649900133112
	axial_symmetry_error: 0.1630030674558
	cloud_turbulence_error: 0.0664153596692813
	max_orbital_radius: 3.22763733053677
	max_surface_roughness: 470.0
	max_magnetosphere_extent: 5.05688254526158
	max_atmospheric_depth: 7.46794233228585
	max_tidal_distortion: 158.5
	max_core_density: 0.738606987222099
	max_ring_system_complexity: 0.709320470988793
	max_impact_crater_count: 0.86408018664132
	max_axial_symmetry: 522.0
	max_cloud_turbulence: 347.5


Examples for Falsely predicted Qtharri when it should have been Fylaran: (Correct answer: Fylaran, What the previous set of rules predicted: Qtharri)
  Entity Data:
	mean_orbital_radius: 2.8100049236252
	mean_surface_roughness: 314.0
	mean_magnetosphere_extent: 4.61512051684126
	mean_atmospheric_depth: 6.63279197893813
	mean_tidal_distortion: 48.0
	mean_core_density: 0.94682623844872
	mean_ring_system_complexity: 0.959610014490111
	mean_impact_crater_count: 0.972318103590771
	mean_axial_symmetry: 87.0
	mean_cloud_turbulence: 37.0
	orbital_radius_error: 0.479374592568275
	surface_roughness_error: 0.999399819891919
	magnetosphere_extent_error: 1.23854753643128
	atmospheric_depth_error: 4.70956473572665
	tidal_distortion_error: 0.053160135440008
	core_density_error: 0.095420123663722
	ring_system_complexity_error: 0.114498908291739
	impact_crater_count_error: 0.0719305220334178
	axial_symmetry_error: 0.100647901120689
	cloud_turbulence_error: 0.0366742416417845
	max_orbital_radius: 2.93969088267037
	max_surface_roughness: 473.0
	max_magnetosphere_extent: 4.76131886847802
	max_atmospheric_depth: 6.89730082107828
	max_tidal_distortion: 84.0
	max_core_density: 0.846955196070128
	max_ring_system_complexity: 0.815660685154976
	max_impact_crater_count: 0.921081718370054
	max_axial_symmetry: 220.0
	max_cloud_turbulence: 94.0


Examples for Falsely predicted Fylaran when it should have been Qtharri: (Correct answer: Qtharri, What the previous set of rules predicted: Fylaran)
  Entity Data:
	mean_orbital_radius: 2.72261035243354
	mean_surface_roughness: 545.0
	mean_magnetosphere_extent: 4.5384960527201
	mean_atmospheric_depth: 6.43759163693504
	mean_tidal_distortion: 89.0
	mean_core_density: 0.905879155720627
	mean_ring_system_complexity: 0.900657479960371
	mean_impact_crater_count: 0.957781012949199
	mean_axial_symmetry: 11.0
	mean_cloud_turbulence: 273.5
	orbital_radius_error: 0.57913728942281
	surface_roughness_error: 1.52446712001276
	magnetosphere_extent_error: 1.45086181285469
	atmospheric_depth_error: 5.4735728733616
	tidal_distortion_error: 0.0794166229450737
	core_density_error: 0.16867127793433
	ring_system_complexity_error: 0.196214168703486
	impact_crater_count_error: 0.100548495761995
	axial_symmetry_error: 0.108857705285386
	cloud_turbulence_error: 0.0599082632030006
	max_orbital_radius: 2.81839825827108
	max_surface_roughness: 560.0
	max_magnetosphere_extent: 4.63957161270542
	max_atmospheric_depth: 6.63987583382654
	max_tidal_distortion: 83.0
	max_core_density: 0.804764204088202
	max_ring_system_complexity: 0.765462339252909
	max_impact_crater_count: 0.924052153503544
	max_axial_symmetry: 11.0
	max_cloud_turbulence: 250.0


Examples for Correctly predicted Qtharri: (Correct answer: Qtharri, What the previous set of rules predicted: Qtharri)
  Entity Data:
	mean_orbital_radius: 2.48240351956988
	mean_surface_roughness: 191.0
	mean_magnetosphere_extent: 4.28675395416645
	mean_atmospheric_depth: 5.92023703781961
	mean_tidal_distortion: 187.0
	mean_core_density: 0.899847026005579
	mean_ring_system_complexity: 0.913600774733457
	mean_impact_crater_count: 0.965129858222424
	mean_axial_symmetry: 55.0
	mean_cloud_turbulence: 433.0
	orbital_radius_error: 0.507346035758633
	surface_roughness_error: 1.17303026388921
	magnetosphere_extent_error: 1.67511193655827
	atmospheric_depth_error: 4.26028168082816
	tidal_distortion_error: 0.0925472852113988
	core_density_error: 0.215360163447189
	ring_system_complexity_error: 0.253574446662119
	impact_crater_count_error: 0.132966161108757
	axial_symmetry_error: 0.123125951772971
	cloud_turbulence_error: 0.0705407683541936
	max_orbital_radius: 2.5922651681085
	max_surface_roughness: 345.0
	max_magnetosphere_extent: 4.51239678583574
	max_atmospheric_depth: 6.16835471390473
	max_tidal_distortion: 356.0
	max_core_density: 0.710126402499645
	max_ring_system_complexity: 0.676635766966642
	max_impact_crater_count: 0.865426222414539
	max_axial_symmetry: 160.0
	max_cloud_turbulence: 452.0


Ensemble Confusion Matrix

Predicted +Predicted -
Actual +293
Actual -331

Accuracy 0.909, Precision 0.906, Recall 0.906, F1 0.906