72/ 100
- One setting, thinking off 72
- Floor47/49, 96% passed
- Middle45/58, 78% passed
- Top32/65, 49% passed
Tested . Strongest in Planning and architecture.
Every answer on this page was written by an AI model, named on the answer. Answers can be wrong, out of date or made up, even when they sound sure. Check anything that matters before you rely on it.
Max effort results are being collected again. We capped every answer at 32,000 output tokens, below the output limit of six of the seven models, so many max effort answers ran out of room while still thinking and scored zero. Low effort results and Haiku 4.5 are not affected. Ranks are hidden until the new answers are in.
Each model answered the same 24 prompts. Open one to read every answer next to its checks, time, tokens and cost.
One row for each model and setting, highest score first. Fable 5.1 at low effort scored highest, 95 out of 100. The four kinds of work count equally in the score; time and cost are medians for one answer.
| Model and setting | Score | Web pages | Code | Planning | Everyday | Checks | Median time | Median cost |
|---|---|---|---|---|---|---|---|---|
| Fable 5.1, low effort | 95 | 98 | 100 | 91 | 92 | 164 of 172 | 20 s | 11¢ |
| Fable 5, max effort | 95 | 95 | 100 | 91 | 94 | 164 of 172 | 1 min 9 s | 29¢ |
| Sonnet 5.5, low effort | 93 | 98 | 98 | 85 | 89 | 160 of 172 | 8.8 s | 1.7¢ |
| Fable 5, low effort | 91 | 92 | 100 | 77 | 96 | 159 of 172 | 15 s | 7.8¢ |
| Opus 5, max effort | 91 | 76 | 100 | 91 | 96 | 156 of 172 | 1 min 1 s | 14¢ |
| Opus 5.5, low effort | 90 | 90 | 98 | 76 | 96 | 157 of 172 | 16 s | 4.1¢ |
| Sonnet 5, low effort | 88 | 79 | 89 | 94 | 92 | 151 of 172 | 15 s | 2.1¢ |
| Opus 5, low effort | 87 | 90 | 100 | 65 | 93 | 153 of 172 | 17 s | 4.7¢ |
| Haiku 4.5 | 72 | 63 | 76 | 77 | 71 | 124 of 172 | 6.8 s | 0.5¢ |
| Fable 5.1, max effort | 72 | 40 | 86 | 60 | 100 | 126 of 172 | 2 min 16 s | 62¢ |
| Sonnet 5, max effort | 54 | 20 | 57 | 57 | 81 | 93 of 172 | 3 min 26 s | 24¢ |
| Sonnet 5.5, max effort | 49 | 0 | 71 | 25 | 100 | 89 of 172 | 3 min 19 s | 30¢ |
| Opus 5.5, max effort | 49 | 0 | 71 | 25 | 98 | 88 of 172 | 4 min 0 s | 55¢ |
Costs are at Anthropic’s API prices on .
72/ 100
Tested . Strongest in Planning and architecture.
95/ 100
Tested . Strongest in Code.
54/ 100
Tested . Strongest in Everyday.
91/ 100
Tested . Strongest in Code.
72/ 100
Tested . Strongest in Everyday.
49/ 100
Tested . Strongest in Everyday.
49/ 100
Tested . Strongest in Everyday.