Ensemble

Dataset: wisconsin

Models

Model Narratives

openai

Round ID: 304
Prompt used:
	To classify an entity as Fylaran or Qtharri, use the following revised rules based on the mean attributes and a weighted scoring system for edge cases:
	
	1. If 'mean_orbital_radius' is greater than or equal to 3.0 and 'mean_surface_roughness' is greater than or equal to 300, classify as Fylaran unless 'mean_core_density' exceeds 0.92.
	2. If 'mean_orbital_radius' is less than 2.6, regardless of other features, classify as Qtharri.
	3. If 'mean_core_density' is greater than 0.91, classify as Qtharri.
	4. If 'mean_core_density' is less than or equal to 0.86 and 'mean_impact_crater_count' is less than 1.0, classify as Fylaran.
	5. If 'mean_orbital_radius' is between 2.6 and 3.0 inclusive, and 'mean_surface_roughness' exceeds 500, classify as Fylaran unless 'mean_core_density' is greater than 0.90 or 'mean_impact_crater_count' exceeds 0.96.
	6. If 'mean_surface_roughness' is less than 200 and 'mean_core_density' is between 0.85 and 0.91, classify as Qtharri.
	
	For edge cases where none of the above rules apply:
	- Calculate a weighted score as follows: (**5×mean_orbital_radius** + **3×mean_surface_roughness** - **4×mean_core_density**) divided by the sum of feature coefficients.
	  - If the score exceeds 2.5, classify as Fylaran.
	  - Otherwise, classify as Qtharri.
	- Additionally, prioritize core_density_errors exceeding 0.12 as Qtharri-indicating if paired with low 'mean_axial_symmetry' below 110.
	
	This approach incorporates additional weighted criteria and avoids strict binary thresholds for borderline cases to reduce misclassifications observed in edge scenarios and improve model interpretability.

Confusion Matrix:
                Predicted Fylaran    Predicted Qtharri   
Actual Fylaran                    19                   13
Actual Qtharri                     3                   31

Accuracy: 0.758
Precision: 0.864
Recall: 0.594
F1 Score: 0.704

Examples for Correctly predicted Fylaran: (Correct answer: Fylaran, What the previous set of rules predicted: Fylaran)
  Entity Data:
	mean_orbital_radius: 3.08831145484708
	mean_surface_roughness: 481.0
	mean_magnetosphere_extent: 4.94092788167144
	mean_atmospheric_depth: 7.21890970761906
	mean_tidal_distortion: 366.0
	mean_core_density: 0.861623298293986
	mean_ring_system_complexity: 0.78665827564506
	mean_impact_crater_count: 0.884173297966401
	mean_axial_symmetry: 529.0
	mean_cloud_turbulence: 181.5
	orbital_radius_error: 1.00199800399003
	surface_roughness_error: 0.90598013223249
	magnetosphere_extent_error: 2.52428207615552
	atmospheric_depth_error: 11.7430830704717
	tidal_distortion_error: 0.0726842486375143
	core_density_error: 0.197686620690425
	ring_system_complexity_error: 0.308512560522258
	impact_crater_count_error: 0.136528385327008
	axial_symmetry_error: 0.154951605348251
	cloud_turbulence_error: 0.0707248188403477
	max_orbital_radius: 3.2801590532851
	max_surface_roughness: 349.0
	max_magnetosphere_extent: 5.11379338619888
	max_atmospheric_depth: 7.60638738977265
	max_tidal_distortion: 174.0
	max_core_density: 0.759186152444579
	max_ring_system_complexity: 0.588546877758813
	max_impact_crater_count: 0.826104915324246
	max_axial_symmetry: 411.0
	max_cloud_turbulence: 261.0


Examples for Falsely predicted Qtharri when it should have been Fylaran: (Correct answer: Fylaran, What the previous set of rules predicted: Qtharri)
  Entity Data:
	mean_orbital_radius: 3.06712226964066
	mean_surface_roughness: 407.5
	mean_magnetosphere_extent: 4.8941014778403
	mean_atmospheric_depth: 7.17548971362422
	mean_tidal_distortion: 103.0
	mean_core_density: 0.922951969579503
	mean_ring_system_complexity: 0.917077823224079
	mean_impact_crater_count: 0.943200467827432
	mean_axial_symmetry: 45.0
	mean_cloud_turbulence: 8.0
	orbital_radius_error: 0.829095893126965
	surface_roughness_error: 1.02029407525478
	magnetosphere_extent_error: 2.26803880037357
	atmospheric_depth_error: 9.13783344124853
	tidal_distortion_error: 0.0892132277187638
	core_density_error: 0.177002824836216
	ring_system_complexity_error: 0.206324986368593
	impact_crater_count_error: 0.129267165204471
	axial_symmetry_error: 0.115801554393713
	cloud_turbulence_error: 0.0627136348811006
	max_orbital_radius: 3.22763733053677
	max_surface_roughness: 319.0
	max_magnetosphere_extent: 5.09190801422499
	max_atmospheric_depth: 7.46794233228585
	max_tidal_distortion: 199.5
	max_core_density: 0.812281699293315
	max_ring_system_complexity: 0.75999392004864
	max_impact_crater_count: 0.873743993010048
	max_axial_symmetry: 52.0
	max_cloud_turbulence: 141.5


Examples for Falsely predicted Fylaran when it should have been Qtharri: (Correct answer: Qtharri, What the previous set of rules predicted: Fylaran)
  Entity Data:
	mean_orbital_radius: 2.53686638871871
	mean_surface_roughness: 256.0
	mean_magnetosphere_extent: 4.3329676843847
	mean_atmospheric_depth: 6.02465751446375
	mean_tidal_distortion: 510.5
	mean_core_density: 0.907688118362531
	mean_ring_system_complexity: 0.933968431867003
	mean_impact_crater_count: 0.966323621780934
	mean_axial_symmetry: 295.5
	mean_cloud_turbulence: 401.0
	orbital_radius_error: 0.553172667437573
	surface_roughness_error: 1.28724512040248
	magnetosphere_extent_error: 1.46799182559032
	atmospheric_depth_error: 4.54092501589709
	tidal_distortion_error: 0.0924121204171834
	core_density_error: 0.151986841535707
	ring_system_complexity_error: 0.171610023017305
	impact_crater_count_error: 0.11823705003086
	axial_symmetry_error: 0.125099960031968
	cloud_turbulence_error: 0.0619677335393187
	max_orbital_radius: 2.64900766046843
	max_surface_roughness: 419.0
	max_magnetosphere_extent: 4.46026001419228
	max_atmospheric_depth: 6.25900768571888
	max_tidal_distortion: 534.0
	max_core_density: 0.789889415481833
	max_ring_system_complexity: 0.776819700147596
	max_impact_crater_count: 0.89142449634516
	max_axial_symmetry: 276.5
	max_cloud_turbulence: 416.0


Examples for Correctly predicted Qtharri: (Correct answer: Qtharri, What the previous set of rules predicted: Qtharri)
  Entity Data:
	mean_orbital_radius: 2.61227324570844
	mean_surface_roughness: 381.5
	mean_magnetosphere_extent: 4.42064620563894
	mean_atmospheric_depth: 6.17669852534897
	mean_tidal_distortion: 341.0
	mean_core_density: 0.892140244446427
	mean_ring_system_complexity: 0.903750564844103
	mean_impact_crater_count: 0.943209364182568
	mean_axial_symmetry: 244.0
	mean_cloud_turbulence: 500.0
	orbital_radius_error: 0.585149553533112
	surface_roughness_error: 1.34275835502893
	magnetosphere_extent_error: 1.64651146367099
	atmospheric_depth_error: 4.5254833995939
	tidal_distortion_error: 0.113622180933126
	core_density_error: 0.201047258126044
	ring_system_complexity_error: 0.225853935099657
	impact_crater_count_error: 0.151492574075431
	axial_symmetry_error: 0.146424041741785
	cloud_turbulence_error: 0.0767528501099471
	max_orbital_radius: 2.66235524184008
	max_surface_roughness: 289.5
	max_magnetosphere_extent: 4.49980967033027
	max_atmospheric_depth: 6.26985357264817
	max_tidal_distortion: 252.5
	max_core_density: 0.816326530612245
	max_ring_system_complexity: 0.818598559266536
	max_impact_crater_count: 0.90049527239982
	max_axial_symmetry: 46.0
	max_cloud_turbulence: 357.0


openai

Round ID: 324
Prompt used:
	To classify an entity as either 'Fylaran' or 'Qtharri,' follow these revised rules. These rules are arranged hierarchically, and conflicts are resolved by strict prioritization. Entities with critical features falling near thresholds will now trigger additional checks.
	
	1. **Primary Orbital and Magnetosphere Rule**:
	   - If mean_orbital_radius > 2.85, classify as Fylaran.
	   - If mean_orbital_radius <= 2.85 and mean_orbital_radius > 2.65 AND mean_magnetosphere_extent > 4.4 and magnetosphere_extent_error < 1.5, classify as Fylaran.
	   - Else, classify as Qtharri.
	
	2. **Surface Roughness Rule**:
	   - If mean_surface_roughness > 460 OR max_surface_roughness > 500, classify as Fylaran IF all of the following conditions hold:
	     - mean_orbital_radius > 2.65
	     - mean_tidal_distortion > 250
	     - mean_cloud_turbulence > 200.
	   - Otherwise, classify as Qtharri.
	
	3. **Magnetosphere-Climate Interaction Rule**:
	   - If mean_magnetosphere_extent > 4.7 AND mean_cloud_turbulence > 450, classify as Fylaran unless mean_tidal_distortion < 200 or max_cloud_turbulence < 400.
	   - Revert to Qtharri if magnetosphere_extent_error > 1.8, regardless of the above.
	
	4. **Core Density and Ring Complexity Rule**:
	   - If mean_core_density > 0.87 AND mean_ring_system_complexity > 0.9, classify as Fylaran IF surface roughness conditions from Rule 2 are also satisfied.
	   - Entities meeting only core_density > 0.87 but failing other criteria must default to Qtharri.
	
	5. **Axial Symmetry and Cloud Override Rule**:
	   - If mean_axial_symmetry > 500 AND mean_cloud_turbulence > 300, classify as Fylaran regardless of other rules.
	   - If mean_axial_symmetry > 500 and mean_cloud_turbulence < 200, override all previous rules and classify as Qtharri.
	
	6. **Atmospheric Depth and Tidal Distortion Rule (Edge Cases)**:
	   - For entities with mean_atmospheric_depth < 6.0:
	     - If max_tidal_distortion > 300 AND mean_core_density > 0.82, classify as Fylaran provided mean_surface_roughness > 220.
	     - Otherwise, classify as Qtharri.
	
	7. **Low-Radius Exception Rule**:
	   - If mean_orbital_radius < 2.5 and magnetosphere_extent_error > 1.2, override all rules and classify as Qtharri.
	
	8. **Final Conflict Resolution Rule**:
	   - If unable to classify definitively after applying all rules, document the entity’s values and default to Qtharri.
	
	### Special Notes:
	- Entities that fit multiple criteria for Fylaran must satisfy the strictest thresholds to override Qtharri classification.
	- Edge cases related to atmospheric depth and magnetosphere extent should be flagged for review in subsequent analyses if thresholds are narrowly exceeded or met.

Confusion Matrix:
                Predicted Fylaran    Predicted Qtharri   
Actual Fylaran                    23                    9
Actual Qtharri                     0                   34

Accuracy: 0.864
Precision: 1.000
Recall: 0.719
F1 Score: 0.836

Examples for Correctly predicted Fylaran: (Correct answer: Fylaran, What the previous set of rules predicted: Fylaran)
  Entity Data:
	mean_orbital_radius: 2.7434173449395
	mean_surface_roughness: 542.0
	mean_magnetosphere_extent: 4.58220857435074
	mean_atmospheric_depth: 6.49193675879448
	mean_tidal_distortion: 506.0
	mean_core_density: 0.86244070720138
	mean_ring_system_complexity: 0.859180341953776
	mean_impact_crater_count: 0.931410901233188
	mean_axial_symmetry: 540.0
	mean_cloud_turbulence: 501.0
	orbital_radius_error: 0.608276253029822
	surface_roughness_error: 1.01636607578175
	magnetosphere_extent_error: 1.69676162144245
	atmospheric_depth_error: 5.70526073023836
	tidal_distortion_error: 0.0748799038460921
	core_density_error: 0.20591260281974
	ring_system_complexity_error: 0.217738375120235
	impact_crater_count_error: 0.104403065089106
	axial_symmetry_error: 0.136271787248865
	cloud_turbulence_error: 0.0739324015570981
	max_orbital_radius: 2.91560622907471
	max_surface_roughness: 546.0
	max_magnetosphere_extent: 4.82911341747287
	max_atmospheric_depth: 6.85033800811219
	max_tidal_distortion: 531.0
	max_core_density: 0.603245460577909
	max_ring_system_complexity: 0.587337013978621
	max_impact_crater_count: 0.853825136612022
	max_axial_symmetry: 547.0
	max_cloud_turbulence: 559.0


Examples for Falsely predicted Qtharri when it should have been Fylaran: (Correct answer: Fylaran, What the previous set of rules predicted: Qtharri)
  Entity Data:
	mean_orbital_radius: 2.59076704048748
	mean_surface_roughness: 535.0
	mean_magnetosphere_extent: 4.40854684448328
	mean_atmospheric_depth: 6.17044720263642
	mean_tidal_distortion: 400.0
	mean_core_density: 0.880824451686779
	mean_ring_system_complexity: 0.9021199819576
	mean_impact_crater_count: 0.956370383121976
	mean_axial_symmetry: 413.0
	mean_cloud_turbulence: 488.0
	orbital_radius_error: 0.63663176169588
	surface_roughness_error: 1.34499070628759
	magnetosphere_extent_error: 1.62542302186231
	atmospheric_depth_error: 5.86856030044848
	tidal_distortion_error: 0.0953834367172834
	core_density_error: 0.196086715511276
	ring_system_complexity_error: 0.193984535466104
	impact_crater_count_error: 0.114934764105557
	axial_symmetry_error: 0.137040140105007
	cloud_turbulence_error: 0.0753126815350509
	max_orbital_radius: 2.81241021642645
	max_surface_roughness: 558.0
	max_magnetosphere_extent: 4.63181211693451
	max_atmospheric_depth: 6.646260636284
	max_tidal_distortion: 550.0
	max_core_density: 0.67999456004352
	max_ring_system_complexity: 0.693240901213172
	max_impact_crater_count: 0.872676498821887
	max_axial_symmetry: 442.0
	max_cloud_turbulence: 544.0


Examples for Correctly predicted Qtharri: (Correct answer: Qtharri, What the previous set of rules predicted: Qtharri)
  Entity Data:
	mean_orbital_radius: 2.69799986524871
	mean_surface_roughness: 98.5
	mean_magnetosphere_extent: 4.49969855304586
	mean_atmospheric_depth: 6.37740698872728
	mean_tidal_distortion: 279.0
	mean_core_density: 0.928608572914345
	mean_ring_system_complexity: 0.95713014098527
	mean_impact_crater_count: 0.964217874670961
	mean_axial_symmetry: 496.0
	mean_cloud_turbulence: 157.0
	orbital_radius_error: 0.497895571380184
	surface_roughness_error: 0.958905626221893
	magnetosphere_extent_error: 1.35277492584687
	atmospheric_depth_error: 4.40567815438214
	tidal_distortion_error: 0.0650768776140958
	core_density_error: 0.124137021069462
	ring_system_complexity_error: 0.120706255016051
	impact_crater_count_error: 0.102127371453494
	axial_symmetry_error: 0.1236122971229
	cloud_turbulence_error: 0.0399124040869502
	max_orbital_radius: 2.77133794033813
	max_surface_roughness: 161.5
	max_magnetosphere_extent: 4.59885025724327
	max_atmospheric_depth: 6.50876913697168
	max_tidal_distortion: 157.0
	max_core_density: 0.85295121119072
	max_ring_system_complexity: 0.872905027932961
	max_impact_crater_count: 0.909148764012255
	max_axial_symmetry: 338.5
	max_cloud_turbulence: 102.0


openai10

Round ID: 329
Prompt used:
	The task is to classify entities as either 'Fylaran' or 'Qtharri' based on their features. Apply the following rules:
	
	1. Classify as 'Fylaran' if the mean_orbital_radius is > 2.6 and the mean_core_density is < 0.92.
	2. Classify as 'Qtharri' if the mean_orbital_radius is <= 2.6 or the mean_core_density is >= 0.92.
	
	Use these rules consistently to make predictions. If any features are missing, label them as 'unknown' and do not classify.

Confusion Matrix:
                Predicted Fylaran    Predicted Qtharri   
Actual Fylaran                    24                    8
Actual Qtharri                     4                   30

Accuracy: 0.818
Precision: 0.857
Recall: 0.750
F1 Score: 0.800

Examples for Correctly predicted Fylaran: (Correct answer: Fylaran, What the previous set of rules predicted: Fylaran)
  Entity Data:
	mean_orbital_radius: 3.0174937653355
	mean_surface_roughness: 283.0
	mean_magnetosphere_extent: 4.8605872978526
	mean_atmospheric_depth: 7.06304816338817
	mean_tidal_distortion: 471.0
	mean_core_density: 0.873515024458421
	mean_ring_system_complexity: 0.815926892950392
	mean_impact_crater_count: 0.893335715561908
	mean_axial_symmetry: 317.0
	mean_cloud_turbulence: 267.0
	orbital_radius_error: 0.752263251794211
	surface_roughness_error: 1.18659175793531
	magnetosphere_extent_error: 1.90551830219497
	atmospheric_depth_error: 8.2304313374209
	tidal_distortion_error: 0.0727186358507914
	core_density_error: 0.168315180539368
	ring_system_complexity_error: 0.206300751331642
	impact_crater_count_error: 0.108443533693808
	axial_symmetry_error: 0.131034346642398
	cloud_turbulence_error: 0.0566656862660288
	max_orbital_radius: 3.21727454350123
	max_surface_roughness: 441.0
	max_magnetosphere_extent: 5.04277974742282
	max_atmospheric_depth: 7.46221493976819
	max_tidal_distortion: 464.0
	max_core_density: 0.728597449908925
	max_ring_system_complexity: 0.627510040160643
	max_impact_crater_count: 0.829187396351575
	max_axial_symmetry: 458.0
	max_cloud_turbulence: 407.0


Examples for Falsely predicted Qtharri when it should have been Fylaran: (Correct answer: Fylaran, What the previous set of rules predicted: Qtharri)
  Entity Data:
	mean_orbital_radius: 2.83438912314523
	mean_surface_roughness: 476.0
	mean_magnetosphere_extent: 4.64150211523548
	mean_atmospheric_depth: 6.68311060154166
	mean_tidal_distortion: 87.0
	mean_core_density: 0.937479492636099
	mean_ring_system_complexity: 0.968063582416093
	mean_impact_crater_count: 0.967838719355806
	mean_axial_symmetry: 74.5
	mean_cloud_turbulence: 117.0
	orbital_radius_error: 0.616035713250458
	surface_roughness_error: 1.08949529599719
	magnetosphere_extent_error: 1.57035027939629
	atmospheric_depth_error: 6.36474665638783
	tidal_distortion_error: 0.0634744042902334
	core_density_error: 0.0962756459339536
	ring_system_complexity_error: 0.104928547116597
	impact_crater_count_error: 0.0871263450398328
	axial_symmetry_error: 0.120830459735946
	cloud_turbulence_error: 0.0551543289325507
	max_orbital_radius: 3.00518743232475
	max_surface_roughness: 516.0
	max_magnetosphere_extent: 4.82671245593533
	max_atmospheric_depth: 7.04838640872188
	max_tidal_distortion: 154.0
	max_core_density: 0.865725911176522
	max_ring_system_complexity: 0.872676498821887
	max_impact_crater_count: 0.909297567629007
	max_axial_symmetry: 336.0
	max_cloud_turbulence: 350.0


Examples for Falsely predicted Fylaran when it should have been Qtharri: (Correct answer: Qtharri, What the previous set of rules predicted: Fylaran)
  Entity Data:
	mean_orbital_radius: 2.73890266458497
	mean_surface_roughness: 512.0
	mean_magnetosphere_extent: 4.57275029473198
	mean_atmospheric_depth: 6.48829266123012
	mean_tidal_distortion: 177.0
	mean_core_density: 0.890471950133571
	mean_ring_system_complexity: 0.908347715505496
	mean_impact_crater_count: 0.962556550197324
	mean_axial_symmetry: 354.5
	mean_cloud_turbulence: 355.0
	orbital_radius_error: 0.504182506638221
	surface_roughness_error: 1.03874924789383
	magnetosphere_extent_error: 1.61709616287962
	atmospheric_depth_error: 4.80728613668877
	tidal_distortion_error: 0.0844866853415377
	core_density_error: 0.215708136146971
	ring_system_complexity_error: 0.195678307433399
	impact_crater_count_error: 0.107796103825695
	axial_symmetry_error: 0.14380542409798
	cloud_turbulence_error: 0.0781728853247723
	max_orbital_radius: 2.84607149899958
	max_surface_roughness: 478.0
	max_magnetosphere_extent: 4.74057482299429
	max_atmospheric_depth: 6.69691078325494
	max_tidal_distortion: 304.0
	max_core_density: 0.704126179411351
	max_ring_system_complexity: 0.712250712250712
	max_impact_crater_count: 0.892458723784025
	max_axial_symmetry: 429.5
	max_cloud_turbulence: 490.5


Examples for Correctly predicted Qtharri: (Correct answer: Qtharri, What the previous set of rules predicted: Qtharri)
  Entity Data:
	mean_orbital_radius: 2.63547950826737
	mean_surface_roughness: 135.5
	mean_magnetosphere_extent: 4.43248207816237
	mean_atmospheric_depth: 6.24358420665871
	mean_tidal_distortion: 360.5
	mean_core_density: 0.926414867105787
	mean_ring_system_complexity: 0.942018746173049
	mean_impact_crater_count: 0.967398664989842
	mean_axial_symmetry: 239.0
	mean_cloud_turbulence: 390.0
	orbital_radius_error: 0.457602447545902
	surface_roughness_error: 0.873842090998139
	magnetosphere_extent_error: 1.10950439386241
	atmospheric_depth_error: 4.20356991139674
	tidal_distortion_error: 0.093407708461347
	core_density_error: 0.141527382509534
	ring_system_complexity_error: 0.152807067899361
	impact_crater_count_error: 0.106395488626163
	axial_symmetry_error: 0.162018517460196
	cloud_turbulence_error: 0.0687459089691888
	max_orbital_radius: 2.69056488676119
	max_surface_roughness: 111.0
	max_magnetosphere_extent: 4.49769632768286
	max_atmospheric_depth: 6.37400215057244
	max_tidal_distortion: 443.5
	max_core_density: 0.828637719588996
	max_ring_system_complexity: 0.816926721673066
	max_impact_crater_count: 0.904486251808973
	max_axial_symmetry: 482.0
	max_cloud_turbulence: 454.0


Ensemble Confusion Matrix

Predicted +Predicted -
Actual +239
Actual -133

Accuracy 0.848, Precision 0.958, Recall 0.719, F1 0.821