ModelLineup

Every answer on this page was written by an AI model, named on the answer. Answers can be wrong, out of date or made up, even when they sound sure. Check anything that matters before you rely on it.

Compare Sonnet 5.5 vs Sonnet 5

Claude Sonnet 5.5 vs Sonnet 5

At max effort, Sonnet 5.5 scored 92 and Sonnet 5 83, 8.9 points apart. At low effort, Sonnet 5.5 scored 93 and Sonnet 5 88, 4.3 points apart, under the 5 points the site counts as level.

Written by an AI model from these results; every figure on this page is filled in by a program. How it was made.

Published

Side by side

Released

Sonnet 5.5

92/ 100

  • Low effort 93
  • Max effort 92

Level, rank 1

  • Floor46/49
  • Middle54/58
  • Top59/65

Tested . Strongest in Code and Everyday.

Released

Sonnet 5

83/ 100

  • Low effort 88
  • Max effort 83

Rank 3

  • Floor45/49
  • Middle51/58
  • Top50/65

Tested . Strongest in Code.

Sonnet 5.5Sonnet 5
LowMaxLowMax
Score93928883
Web pages98807974
Code9810089100
Planning85889463
Everyday891009296
Checks passed160 of 172159 of 172151 of 172146 of 172
Median time8.8 s2 min 17 s15 s4 min 0 s
Median cost1.7¢20¢2.1¢24¢

Scored higher by 5 points or more: Sonnet 5.5 on building web pages, 80 to 74; Sonnet 5.5 on planning and architecture, 88 to 63. Within 5 points on code and everyday.

Sonnet 5.5’s median max effort answer took 2 min 17 s and cost 20¢ at API prices, and Sonnet 5’s median max effort answer took 4 min 0 s and cost 24¢. A median Sonnet 5 answer cost 1.2 times as much.

Of the 24 prompts at max effort, Sonnet 5.5 passed more checks on 5, Sonnet 5 on 1, and the two passed the same number on 18.

Where they differed

Prompts where the two passed a different number of checks at max effort, widest gap first.

  • A03 Rename a column with no downtime

    Sonnet 5.5 8 of 9, Sonnet 5 0 of 9.

    Passed by Sonnet 5.5, missed by Sonnet 5: Gives numbered steps; Adds a new handle column; Keeps both columns in step with a trigger or dual writes; Copies the existing 40 million rows in batches; Builds the unique index with CREATE INDEX CONCURRENTLY; Does not use RENAME COLUMN as the way to move while old code needs username; Keeps returning username to old mobile apps until they are gone; Gives a way back at every step

  • R02 Did cycling in town really double?

    Sonnet 5.5 6 of 6, Sonnet 5 4 of 6.

    Passed by Sonnet 5.5, missed by Sonnet 5: Puts the town-wide rise at about 50%; Notices the 1,890 total does not match the rows

  • A02 Should we switch to microservices?

    Sonnet 5.5 8 of 8, Sonnet 5 6 of 8.

    Passed by Sonnet 5.5, missed by Sonnet 5: Says when splitting would make sense; Suggests a middle path: clear modules inside the monolith

  • B02 Build a dashboard from a picture of its design

    Sonnet 5.5 7 of 7, Sonnet 5 6 of 7.

    Passed by Sonnet 5.5, missed by Sonnet 5: Side by side with the picture, a designer would accept it as a faithful build

  • B05 Fix three layout bugs on a garden page

    Sonnet 5.5 7 of 7, Sonnet 5 6 of 7.

    Passed by Sonnet 5.5, missed by Sonnet 5: On a 375 px phone the page no longer scrolls sideways

  • A01 Plan a booking app for a dog groomer

    Sonnet 5.5 8 of 9, Sonnet 5 9 of 9.

    Passed by Sonnet 5, missed by Sonnet 5.5: The first phase is small and usable before payments exist

Every prompt

Checks passed on each prompt, at each setting. Each prompt links to its description.

Sonnet 5.5Sonnet 5
PromptLowMaxLowMax
Building web pages
B01 A landing page for a small invoicing app9 of 99 of 97 of 99 of 9
B02 Build a dashboard from a picture of its design7 of 77 of 76 of 76 of 7
B03 A kanban board that survives a reload8 of 90 of 98 of 90 of 9
B04 Minesweeper in one HTML file9 of 99 of 95 of 99 of 9
B05 Fix three layout bugs on a garden page7 of 77 of 76 of 76 of 7
Code
F01 Load more shows some posts twice and skips others7 of 77 of 77 of 77 of 7
F02 The search box shows results for an old query7 of 77 of 77 of 77 of 7
F03 Some subscriptions renew a day early7 of 77 of 76 of 77 of 7
F04 Review a pull request before merging6 of 77 of 77 of 77 of 7
F05 SQL: which customers left and came back7 of 77 of 74 of 77 of 7
F06 A contacts import that survives real CSV files9 of 99 of 97 of 99 of 9
F07 Make a slow script fast7 of 77 of 77 of 77 of 7
Planning and architecture
A01 Plan a booking app for a dog groomer7 of 98 of 98 of 99 of 9
A02 Should we switch to microservices?7 of 88 of 87 of 86 of 8
A03 Rename a column with no downtime8 of 98 of 99 of 90 of 9
A04 Turn a messy feature brief into a spec7 of 86 of 88 of 86 of 8
Everyday
W01 Text the plumber to reschedule5 of 66 of 66 of 66 of 6
I01 Check a market receipt adds up5 of 55 of 55 of 55 of 5
H02 Summing up a book that doesn't exist4 of 55 of 55 of 55 of 5
W02 Turn a messy thread into one clear update6 of 66 of 66 of 66 of 6
K02 Answer questions from a bread maker manual6 of 66 of 66 of 66 of 6
R02 Did cycling in town really double?4 of 66 of 63 of 64 of 6
P02 Filling a week of volunteer shifts6 of 66 of 66 of 66 of 6
S02 A story of exactly 100 words5 of 66 of 65 of 66 of 6

What max effort changed

  • Sonnet 5.5. Max passed 1 fewer check, cost 15.5 times as much and took 18.0 times as long.
  • Sonnet 5. Max passed 5 fewer checks, cost 8.4 times as much and took 10.8 times as long.

More comparisons

Compare any two modelsEvery answer from Sonnet 5.5Every answer from Sonnet 5