Leaderboard
- Each bar shows the score over all 80 tasks. Its brighter part is the Hard score.
- Costs are for all 80 tasks, with subscription usage given as a share of one week's limit on a $200 plan and API price in USD. A model that answered fewer tasks is scaled to 80 from its average cost per answered task.
- Fable 5.2 and Opus 5.5 answered 72 of 80 tasks, Fable 5.1 67, Sonnet 5.5 and Haiku 5.5 79, and the GPT models all 80. Tasks a model's safety filters stopped are left out of its score.
Per-field breakdown
Fable 5.2 leads Physics and Astronomy, Chemistry and Materials, Mathematics and TCS, and Life Sciences. Opus 5.5 leads Earth and Planetary. The leader in each field is highlighted. A dash means the model answered fewer than 7 tasks in that field (Fable 5.1 in Life Sciences).