Ensemble

Dataset: wisconsin

Models

Model Narratives

anthropic37

Round ID: 202
Prompt used:
	To determine if an entity is Fylaran or Qtharri, evaluate the following classification rules:
	
	Entity is classified as Fylaran if it meets at least 3 of these primary criteria:
	1. mean_orbital_radius > 2.75
	2. mean_magnetosphere_extent > 4.55
	3. mean_atmospheric_depth > 6.50
	4. mean_tidal_distortion > 300
	5. orbital_radius_error > 0.7 OR magnetosphere_extent_error > 1.8 OR atmospheric_depth_error > 7.0
	
	Entity is classified as Qtharri if it meets at least 3 of these primary criteria:
	1. mean_orbital_radius < 2.70
	2. mean_core_density > 0.94
	3. mean_ring_system_complexity > 0.94
	4. mean_impact_crater_count > 0.97
	5. mean_tidal_distortion < 100
	
	In cases where an entity meets criteria for both categories or fails to meet 3 criteria for either category, apply the following tiebreaker rules in order:
	- If mean_orbital_radius > 2.8 AND mean_magnetosphere_extent > 4.6, classify as Fylaran
	- If mean_core_density > 0.95 AND mean_impact_crater_count > 0.98, classify as Qtharri
	- If mean_tidal_distortion > 400, classify as Fylaran
	- If mean_axial_symmetry < 50 AND mean_cloud_turbulence < 50, classify as Qtharri
	- If atmospheric_depth_error > 8.0, classify as Fylaran
	- If none of the above applies, classify based on mean_orbital_radius (> 2.7 = Fylaran, ≤ 2.7 = Qtharri)

Confusion Matrix:
                Predicted Fylaran    Predicted Qtharri   
Actual Fylaran                    29                    3
Actual Qtharri                    13                   21

Accuracy: 0.758
Precision: 0.690
Recall: 0.906
F1 Score: 0.784

Examples for Correctly predicted Fylaran: (Correct answer: Fylaran, What the previous set of rules predicted: Fylaran)
  Entity Data:
	mean_orbital_radius: 3.00071981506503
	mean_surface_roughness: 529.0
	mean_magnetosphere_extent: 4.86830338551846
	mean_atmospheric_depth: 7.03262426102801
	mean_tidal_distortion: 545.0
	mean_core_density: 0.848104486472733
	mean_ring_system_complexity: 0.837731423305688
	mean_impact_crater_count: 0.871915598570058
	mean_axial_symmetry: 155.5
	mean_cloud_turbulence: 512.0
	orbital_radius_error: 0.720416546173115
	surface_roughness_error: 1.7058722109232
	magnetosphere_extent_error: 2.40852652051
	atmospheric_depth_error: 8.19145896650896
	tidal_distortion_error: 0.0868619594529159
	core_density_error: 0.245967477524977
	ring_system_complexity_error: 0.146082168658601
	impact_crater_count_error: 0.135757136092362
	axial_symmetry_error: 0.174814187067297
	cloud_turbulence_error: 0.101931349446576
	max_orbital_radius: 3.06011453248326
	max_surface_roughness: 495.0
	max_magnetosphere_extent: 4.95793750509581
	max_atmospheric_depth: 7.1693500166706
	max_tidal_distortion: 357.0
	max_core_density: 0.78021377857533
	max_ring_system_complexity: 0.804375804375804
	max_impact_crater_count: 0.844523266615995
	max_axial_symmetry: 76.0
	max_cloud_turbulence: 425.0


Examples for Falsely predicted Qtharri when it should have been Fylaran: (Correct answer: Fylaran, What the previous set of rules predicted: Qtharri)
  Entity Data:
	mean_orbital_radius: 2.62249231274056
	mean_surface_roughness: 457.0
	mean_magnetosphere_extent: 4.41546141076012
	mean_atmospheric_depth: 6.22910254457264
	mean_tidal_distortion: 207.0
	mean_core_density: 0.94552812473407
	mean_ring_system_complexity: 0.955009502344548
	mean_impact_crater_count: 0.973671911512697
	mean_axial_symmetry: 112.0
	mean_cloud_turbulence: 240.0
	orbital_radius_error: 0.486518242206806
	surface_roughness_error: 1.17473401244707
	magnetosphere_extent_error: 1.20706255016051
	atmospheric_depth_error: 4.45757781760453
	tidal_distortion_error: 0.086596766683289
	core_density_error: 0.109635760589326
	ring_system_complexity_error: 0.152708873350569
	impact_crater_count_error: 0.0944457516249408
	axial_symmetry_error: 0.128335497817245
	cloud_turbulence_error: 0.0512737749731771
	max_orbital_radius: 2.74019465442878
	max_surface_roughness: 507.0
	max_magnetosphere_extent: 4.53302950821041
	max_atmospheric_depth: 6.48402436206708
	max_tidal_distortion: 393.0
	max_core_density: 0.867829558274755
	max_ring_system_complexity: 0.821220333415455
	max_impact_crater_count: 0.914653666389222
	max_axial_symmetry: 291.5
	max_cloud_turbulence: 297.0


Examples for Falsely predicted Fylaran when it should have been Qtharri: (Correct answer: Qtharri, What the previous set of rules predicted: Fylaran)
  Entity Data:
	mean_orbital_radius: 2.63547950826737
	mean_surface_roughness: 135.5
	mean_magnetosphere_extent: 4.43248207816237
	mean_atmospheric_depth: 6.24358420665871
	mean_tidal_distortion: 360.5
	mean_core_density: 0.926414867105787
	mean_ring_system_complexity: 0.942018746173049
	mean_impact_crater_count: 0.967398664989842
	mean_axial_symmetry: 239.0
	mean_cloud_turbulence: 390.0
	orbital_radius_error: 0.457602447545902
	surface_roughness_error: 0.873842090998139
	magnetosphere_extent_error: 1.10950439386241
	atmospheric_depth_error: 4.20356991139674
	tidal_distortion_error: 0.093407708461347
	core_density_error: 0.141527382509534
	ring_system_complexity_error: 0.152807067899361
	impact_crater_count_error: 0.106395488626163
	axial_symmetry_error: 0.162018517460196
	cloud_turbulence_error: 0.0687459089691888
	max_orbital_radius: 2.69056488676119
	max_surface_roughness: 111.0
	max_magnetosphere_extent: 4.49769632768286
	max_atmospheric_depth: 6.37400215057244
	max_tidal_distortion: 443.5
	max_core_density: 0.828637719588996
	max_ring_system_complexity: 0.816926721673066
	max_impact_crater_count: 0.904486251808973
	max_axial_symmetry: 482.0
	max_cloud_turbulence: 454.0


Examples for Correctly predicted Qtharri: (Correct answer: Qtharri, What the previous set of rules predicted: Qtharri)
  Entity Data:
	mean_orbital_radius: 2.5687881337687
	mean_surface_roughness: 70.0
	mean_magnetosphere_extent: 4.36995405343961
	mean_atmospheric_depth: 6.10991402730753
	mean_tidal_distortion: 396.5
	mean_core_density: 0.916657500091666
	mean_ring_system_complexity: 0.938156709696788
	mean_impact_crater_count: 0.973245481707851
	mean_axial_symmetry: 190.0
	mean_cloud_turbulence: 232.0
	orbital_radius_error: 0.513419906119737
	surface_roughness_error: 0.854049178911847
	magnetosphere_extent_error: 1.35941163743731
	atmospheric_depth_error: 4.45757781760453
	tidal_distortion_error: 0.0740810367098085
	core_density_error: 0.119457105272144
	ring_system_complexity_error: 0.152381101190404
	impact_crater_count_error: 0.0752329714952161
	axial_symmetry_error: 0.119498953970317
	cloud_turbulence_error: 0.0492138191974571
	max_orbital_radius: 2.69192081917233
	max_surface_roughness: 130.0
	max_magnetosphere_extent: 4.50953995497284
	max_atmospheric_depth: 6.36921581664863
	max_tidal_distortion: 449.0
	max_core_density: 0.822639025995393
	max_ring_system_complexity: 0.766283524904215
	max_impact_crater_count: 0.938544130345009
	max_axial_symmetry: 252.0
	max_cloud_turbulence: 338.0


gemini25

Round ID: 125
Prompt used:
	Predict the classification based on the following rules. Use the first rule that matches:
	
	1. If mean_atmospheric_depth >= 6.7 AND mean_surface_roughness >= 200, predict Fylaran.
	2. Else if max_atmospheric_depth >= 7.0 AND mean_surface_roughness >= 100, predict Fylaran.
	3. Else if mean_core_density >= 0.92 AND mean_atmospheric_depth < 6.2, predict Qtharri.
	4. Else if max_atmospheric_depth >= 6.8 AND mean_surface_roughness >= 100, predict Fylaran.
	5. Else if mean_atmospheric_depth >= 6.2 AND mean_surface_roughness >= 400 AND mean_core_density < 0.92, predict Fylaran.
	6. Else (if none of the above conditions is met), predict Qtharri.
	
	Classification:
	

Confusion Matrix:
                Predicted Fylaran    Predicted Qtharri   
Actual Fylaran                    26                    6
Actual Qtharri                     1                   33

Accuracy: 0.894
Precision: 0.963
Recall: 0.812
F1 Score: 0.881

Examples for Correctly predicted Fylaran: (Correct answer: Fylaran, What the previous set of rules predicted: Fylaran)
  Entity Data:
	mean_orbital_radius: 2.82435065679837
	mean_surface_roughness: 489.5
	mean_magnetosphere_extent: 4.65109911787649
	mean_atmospheric_depth: 6.66402629405882
	mean_tidal_distortion: 112.0
	mean_core_density: 0.90892564988184
	mean_ring_system_complexity: 0.909603594753406
	mean_impact_crater_count: 0.949090771041342
	mean_axial_symmetry: 333.5
	mean_cloud_turbulence: 23.0
	orbital_radius_error: 0.635059052372297
	surface_roughness_error: 1.03826778819339
	magnetosphere_extent_error: 1.70381923923872
	atmospheric_depth_error: 6.04814021001498
	tidal_distortion_error: 0.0988382517044894
	core_density_error: 0.176804977305505
	ring_system_complexity_error: 0.224744299149055
	impact_crater_count_error: 0.141138230115019
	axial_symmetry_error: 0.172655726809162
	cloud_turbulence_error: 0.0547905101272109
	max_orbital_radius: 2.88144312715186
	max_surface_roughness: 368.5
	max_magnetosphere_extent: 4.72738781871234
	max_atmospheric_depth: 6.77707695534002
	max_tidal_distortion: 118.0
	max_core_density: 0.838644750083865
	max_ring_system_complexity: 0.811556565492615
	max_impact_crater_count: 0.899361453368109
	max_axial_symmetry: 279.0
	max_cloud_turbulence: 31.0


Examples for Falsely predicted Qtharri when it should have been Fylaran: (Correct answer: Fylaran, What the previous set of rules predicted: Qtharri)
  Entity Data:
	mean_orbital_radius: 2.59897910604785
	mean_surface_roughness: 120.0
	mean_magnetosphere_extent: 4.42568460401334
	mean_atmospheric_depth: 6.16981991563206
	mean_tidal_distortion: 559.0
	mean_core_density: 0.854700854700855
	mean_ring_system_complexity: 0.863707030575229
	mean_impact_crater_count: 0.925163522652629
	mean_axial_symmetry: 487.0
	mean_cloud_turbulence: 541.0
	orbital_radius_error: 0.57835974963685
	surface_roughness_error: 0.943504107039286
	magnetosphere_extent_error: 1.48895936814945
	atmospheric_depth_error: 5.21440312979348
	tidal_distortion_error: 0.0866602561731732
	core_density_error: 0.182893411581719
	ring_system_complexity_error: 0.191624633072056
	impact_crater_count_error: 0.106630202100531
	axial_symmetry_error: 0.147139389695622
	cloud_turbulence_error: 0.0712881476824865
	max_orbital_radius: 2.80154054418955
	max_surface_roughness: 232.0
	max_magnetosphere_extent: 4.64822967544854
	max_atmospheric_depth: 6.61015754174298
	max_tidal_distortion: 553.0
	max_core_density: 0.655780706931602
	max_ring_system_complexity: 0.651253663301856
	max_impact_crater_count: 0.851716208159441
	max_axial_symmetry: 536.0
	max_cloud_turbulence: 549.0


Examples for Falsely predicted Fylaran when it should have been Qtharri: (Correct answer: Qtharri, What the previous set of rules predicted: Fylaran)
  Entity Data:
	mean_orbital_radius: 2.73890266458497
	mean_surface_roughness: 512.0
	mean_magnetosphere_extent: 4.57275029473198
	mean_atmospheric_depth: 6.48829266123012
	mean_tidal_distortion: 177.0
	mean_core_density: 0.890471950133571
	mean_ring_system_complexity: 0.908347715505496
	mean_impact_crater_count: 0.962556550197324
	mean_axial_symmetry: 354.5
	mean_cloud_turbulence: 355.0
	orbital_radius_error: 0.504182506638221
	surface_roughness_error: 1.03874924789383
	magnetosphere_extent_error: 1.61709616287962
	atmospheric_depth_error: 4.80728613668877
	tidal_distortion_error: 0.0844866853415377
	core_density_error: 0.215708136146971
	ring_system_complexity_error: 0.195678307433399
	impact_crater_count_error: 0.107796103825695
	axial_symmetry_error: 0.14380542409798
	cloud_turbulence_error: 0.0781728853247723
	max_orbital_radius: 2.84607149899958
	max_surface_roughness: 478.0
	max_magnetosphere_extent: 4.74057482299429
	max_atmospheric_depth: 6.69691078325494
	max_tidal_distortion: 304.0
	max_core_density: 0.704126179411351
	max_ring_system_complexity: 0.712250712250712
	max_impact_crater_count: 0.892458723784025
	max_axial_symmetry: 429.5
	max_cloud_turbulence: 490.5


Examples for Correctly predicted Qtharri: (Correct answer: Qtharri, What the previous set of rules predicted: Qtharri)
  Entity Data:
	mean_orbital_radius: 2.44060639089142
	mean_surface_roughness: 337.5
	mean_magnetosphere_extent: 4.21538155726493
	mean_atmospheric_depth: 5.82511475982373
	mean_tidal_distortion: 448.0
	mean_core_density: 0.943654396014004
	mean_ring_system_complexity: 0.953916303383541
	mean_impact_crater_count: 0.970214417386242
	mean_axial_symmetry: 246.5
	mean_cloud_turbulence: 381.0
	orbital_radius_error: 0.609836043539573
	surface_roughness_error: 1.61616830806695
	magnetosphere_extent_error: 1.58650559406515
	atmospheric_depth_error: 4.8187135212627
	tidal_distortion_error: 0.126649121591901
	core_density_error: 0.117728501222091
	ring_system_complexity_error: 0.136565002837477
	impact_crater_count_error: 0.106442472725881
	axial_symmetry_error: 0.186440338982743
	cloud_turbulence_error: 0.0596657355607052
	max_orbital_radius: 2.52412736294128
	max_surface_roughness: 424.0
	max_magnetosphere_extent: 4.31321231867352
	max_atmospheric_depth: 6.00091970587874
	max_tidal_distortion: 465.5
	max_core_density: 0.906947215672048
	max_ring_system_complexity: 0.89437438511761
	max_impact_crater_count: 0.936891020836456
	max_axial_symmetry: 317.0
	max_cloud_turbulence: 243.0


opus40

Round ID: 245
Prompt used:
	Classify the entity as either Fylaran or Qtharri based on the following rules:
	
	1. If mean_impact_crater_count >= 0.980, classify as Qtharri
	
	2. If mean_impact_crater_count >= 0.965 and mean_impact_crater_count < 0.980:
	   - If mean_surface_roughness < 200, classify as Qtharri
	   - If mean_surface_roughness >= 400, classify as Fylaran
	   - Otherwise, if mean_orbital_radius >= 2.85, classify as Fylaran
	   - Otherwise, classify as Qtharri
	
	3. If mean_impact_crater_count < 0.935, classify as Fylaran
	
	4. If mean_impact_crater_count >= 0.935 and mean_impact_crater_count < 0.965:
	   - If mean_surface_roughness < 150, classify as Qtharri
	   - If mean_ring_system_complexity >= 0.965, classify as Qtharri
	   - If mean_ring_system_complexity < 0.915, classify as Fylaran
	   - If mean_ring_system_complexity >= 0.915 and mean_ring_system_complexity < 0.965:
	     * If mean_orbital_radius < 2.65, classify as Qtharri
	     * If mean_orbital_radius >= 2.82, classify as Fylaran
	     * If mean_orbital_radius >= 2.65 and mean_orbital_radius < 2.82:
	       - If mean_surface_roughness < 250, classify as Qtharri
	       - If mean_core_density >= 0.915, classify as Qtharri
	       - Otherwise, classify as Fylaran
	
	Apply these rules in order and stop at the first classification decision.

Confusion Matrix:
                Predicted Fylaran    Predicted Qtharri   
Actual Fylaran                    30                    2
Actual Qtharri                     5                   29

Accuracy: 0.894
Precision: 0.857
Recall: 0.938
F1 Score: 0.896

Examples for Correctly predicted Fylaran: (Correct answer: Fylaran, What the previous set of rules predicted: Fylaran)
  Entity Data:
	mean_orbital_radius: 2.62249231274056
	mean_surface_roughness: 457.0
	mean_magnetosphere_extent: 4.41546141076012
	mean_atmospheric_depth: 6.22910254457264
	mean_tidal_distortion: 207.0
	mean_core_density: 0.94552812473407
	mean_ring_system_complexity: 0.955009502344548
	mean_impact_crater_count: 0.973671911512697
	mean_axial_symmetry: 112.0
	mean_cloud_turbulence: 240.0
	orbital_radius_error: 0.486518242206806
	surface_roughness_error: 1.17473401244707
	magnetosphere_extent_error: 1.20706255016051
	atmospheric_depth_error: 4.45757781760453
	tidal_distortion_error: 0.086596766683289
	core_density_error: 0.109635760589326
	ring_system_complexity_error: 0.152708873350569
	impact_crater_count_error: 0.0944457516249408
	axial_symmetry_error: 0.128335497817245
	cloud_turbulence_error: 0.0512737749731771
	max_orbital_radius: 2.74019465442878
	max_surface_roughness: 507.0
	max_magnetosphere_extent: 4.53302950821041
	max_atmospheric_depth: 6.48402436206708
	max_tidal_distortion: 393.0
	max_core_density: 0.867829558274755
	max_ring_system_complexity: 0.821220333415455
	max_impact_crater_count: 0.914653666389222
	max_axial_symmetry: 291.5
	max_cloud_turbulence: 297.0


Examples for Falsely predicted Qtharri when it should have been Fylaran: (Correct answer: Fylaran, What the previous set of rules predicted: Qtharri)
  Entity Data:
	mean_orbital_radius: 2.8100049236252
	mean_surface_roughness: 314.0
	mean_magnetosphere_extent: 4.61512051684126
	mean_atmospheric_depth: 6.63279197893813
	mean_tidal_distortion: 48.0
	mean_core_density: 0.94682623844872
	mean_ring_system_complexity: 0.959610014490111
	mean_impact_crater_count: 0.972318103590771
	mean_axial_symmetry: 87.0
	mean_cloud_turbulence: 37.0
	orbital_radius_error: 0.479374592568275
	surface_roughness_error: 0.999399819891919
	magnetosphere_extent_error: 1.23854753643128
	atmospheric_depth_error: 4.70956473572665
	tidal_distortion_error: 0.053160135440008
	core_density_error: 0.095420123663722
	ring_system_complexity_error: 0.114498908291739
	impact_crater_count_error: 0.0719305220334178
	axial_symmetry_error: 0.100647901120689
	cloud_turbulence_error: 0.0366742416417845
	max_orbital_radius: 2.93969088267037
	max_surface_roughness: 473.0
	max_magnetosphere_extent: 4.76131886847802
	max_atmospheric_depth: 6.89730082107828
	max_tidal_distortion: 84.0
	max_core_density: 0.846955196070128
	max_ring_system_complexity: 0.815660685154976
	max_impact_crater_count: 0.921081718370054
	max_axial_symmetry: 220.0
	max_cloud_turbulence: 94.0


Examples for Falsely predicted Fylaran when it should have been Qtharri: (Correct answer: Qtharri, What the previous set of rules predicted: Fylaran)
  Entity Data:
	mean_orbital_radius: 2.64262239577975
	mean_surface_roughness: 268.5
	mean_magnetosphere_extent: 4.45539326066986
	mean_atmospheric_depth: 6.24027584517077
	mean_tidal_distortion: 464.0
	mean_core_density: 0.884642604387827
	mean_ring_system_complexity: 0.912383785115371
	mean_impact_crater_count: 0.946942795185743
	mean_axial_symmetry: 470.0
	mean_cloud_turbulence: 397.0
	orbital_radius_error: 0.557314991723711
	surface_roughness_error: 1.22882057274445
	magnetosphere_extent_error: 1.60934769394311
	atmospheric_depth_error: 4.64435140789325
	tidal_distortion_error: 0.088357229472183
	core_density_error: 0.198292712927127
	ring_system_complexity_error: 0.226097324177001
	impact_crater_count_error: 0.136967149346111
	axial_symmetry_error: 0.169115345252878
	cloud_turbulence_error: 0.0755976190101249
	max_orbital_radius: 2.72063731660768
	max_surface_roughness: 262.0
	max_magnetosphere_extent: 4.55619000376637
	max_atmospheric_depth: 6.38384441566749
	max_tidal_distortion: 309.5
	max_core_density: 0.790014220255965
	max_ring_system_complexity: 0.795355126063788
	max_impact_crater_count: 0.8882572392965
	max_axial_symmetry: 408.5
	max_cloud_turbulence: 341.0


Examples for Correctly predicted Qtharri: (Correct answer: Qtharri, What the previous set of rules predicted: Qtharri)
  Entity Data:
	mean_orbital_radius: 2.6217658325052
	mean_surface_roughness: 285.0
	mean_magnetosphere_extent: 4.41727311486095
	mean_atmospheric_depth: 6.20979654142497
	mean_tidal_distortion: 294.0
	mean_core_density: 0.926337631539944
	mean_ring_system_complexity: 0.973823621065753
	mean_impact_crater_count: 0.982501645690256
	mean_axial_symmetry: 257.0
	mean_cloud_turbulence: 294.5
	orbital_radius_error: 0.470425339453563
	surface_roughness_error: 1.13357840487546
	magnetosphere_extent_error: 1.23895116933639
	atmospheric_depth_error: 4.1545156155682
	tidal_distortion_error: 0.0748865809073962
	core_density_error: 0.128296531519757
	ring_system_complexity_error: 0.123652739557197
	impact_crater_count_error: 0.0999849988748312
	axial_symmetry_error: 0.138166566143912
	cloud_turbulence_error: 0.046184412955022
	max_orbital_radius: 2.69124308278583
	max_surface_roughness: 312.0
	max_magnetosphere_extent: 4.48661184986396
	max_atmospheric_depth: 6.364234272378
	max_tidal_distortion: 269.0
	max_core_density: 0.844665934622857
	max_ring_system_complexity: 0.888494002665482
	max_impact_crater_count: 0.923258734027624
	max_axial_symmetry: 250.5
	max_cloud_turbulence: 156.0


Ensemble Confusion Matrix

Predicted +Predicted -
Actual +293
Actual -331

Accuracy 0.909, Precision 0.906, Recall 0.906, F1 0.906