ModelLineup

Every answer on this page was written by an AI model, named on the answer. Answers can be wrong, out of date or made up, even when they sound sure. Check anything that matters before you rely on it.

Articles Seven Claude models, one Minesweeper prompt

Seven Claude models, one Minesweeper prompt

Written by an AI model from these results; every figure in this article is filled in by a program. How it was made.

Every model got the same request, word for word, at each of its settings: 13 answers in all. In plain words, the request: Asks for the game Minesweeper in one HTML file: a 9 by 9 board with 10 mines, flags on right click, a mines-left counter, a first square that is never a mine, empty areas that open by themselves, win and lose messages and a new game button. Every square has to be a button so the game works from the keyboard, and the board has to fit a phone.

Six of the 13 answers passed all 9 checks: Sonnet 5.5 at low effort, Sonnet 5.5 at max effort, Opus 5.5 at max effort, Fable 5.1 at low effort, Sonnet 5 at max effort and Fable 5 at max effort.

The games

The top of each game, from our own screenshot at a desktop width, newest model first. One answer has only a phone screenshot, shown narrow. Open one for the answer, its checks and every screenshot.

The checks

A program opened each game in a real browser and played it. It looked for these nine things, and this is how many of the 13 answers missed each one:

  • Numbers are right and an empty square opens its neighbours: missed by 7 of 13.
  • Right click flags and unflags, the counter follows, a flagged square stays shut: missed by 3 of 13.
  • New game resets the board, counter and message: missed by 3 of 13.
  • 81 square buttons in a 9 by 9 grid, Mines left starts at 10: missed by 1 of 13.
  • Hitting a mine says Game over, shows all 10 mines as 💣 and stops the board: missed by 1 of 13.
  • Opening every safe square shows You win! (and not before): missed by 1 of 13.
  • Fits a 375 px phone with squares of at least 32 px, no sideways scroll: missed by 1 of 13.
  • A first click never lands on a mine: no answer missed it.
  • The squares work from the keyboard: no answer missed it.

The check missed most often, by 7 of 13 answers: “Numbers are right and an empty square opens its neighbours”. Every answer passed two of the checks.

Checks passed by each answer to the Minesweeper prompt, and the checks it missed
AnswerPassedMissed
Sonnet 5.5 at low effort9 of 9Nothing
Sonnet 5.5 at max effort9 of 9Nothing
Opus 5.5 at low effort8 of 9Numbers are right and an empty square opens its neighbours
Opus 5.5 at max effort9 of 9Nothing
Fable 5.1 at low effort9 of 9Nothing
Fable 5.1 at max effort8 of 9Numbers are right and an empty square opens its neighbours
Opus 5 at low effort6 of 9Numbers are right and an empty square opens its neighbours; Right click flags and unflags, the counter follows, a flagged square stays shut; New game resets the board, counter and message
Opus 5 at max effort8 of 9Numbers are right and an empty square opens its neighbours
Sonnet 5 at low effort5 of 981 square buttons in a 9 by 9 grid, Mines left starts at 10; Numbers are right and an empty square opens its neighbours; Right click flags and unflags, the counter follows, a flagged square stays shut; New game resets the board, counter and message
Sonnet 5 at max effort9 of 9Nothing
Fable 5 at low effort8 of 9Numbers are right and an empty square opens its neighbours
Fable 5 at max effort9 of 9Nothing
Haiku 4.53 of 9Numbers are right and an empty square opens its neighbours; Right click flags and unflags, the counter follows, a flagged square stays shut; Hitting a mine says Game over, shows all 10 mines as 💣 and stops the board; Opening every safe square shows You win! (and not before); New game resets the board, counter and message; Fits a 375 px phone with squares of at least 32 px, no sideways scroll

Low effort against max effort

Opus 5.5 passed 8 of 9 at low effort and 9 at max, Fable 5.1 passed 9 of 9 at low effort and 8 at max, Opus 5 passed 6 of 9 at low effort and 8 at max, Sonnet 5 passed 5 of 9 at low effort and 9 at max and Fable 5 passed 8 of 9 at low effort and 9 at max. Every other model with both settings passed the same number at each.

More like this

Minesweeper is one of five web page prompts. Every page each model built, with the scores for all of them.