Publication

Model summary · Edition 1.1

Claude Sonnet 5.5High

These results come from one run: 10 fixed subjects, 3 rounds each, a 40-question limit, and reasoning setting high. They do not predict results on other subjects or settings.

This page always shows the model’s newest ranked run.

Every question, answer, guess, and source.

Result

Rank
Rank 9of 20 models
Question score
17.83 Lower is better. 95% confidence interval 15.49 to 20.18.
Rounds solved
27 of 30 0 format errors
Guesser cost per round
$0.0460 Model time 55s.
See how Claude Sonnet 5.5 (high) played. All 30 rounds, with every question, answer, guess, and source.

Observations

What stood out in this run.

Counts and ranks from this run only. A subject rank compares this model’s average on that subject with every other model in this edition. Each item links to its rounds.

Best ranks vs other models

Lowest ranks vs other models

Single rounds

  • Fewest questions in a solved round: 8, on Achilles. round 3
  • Most questions in a solved round: 33, on Bike pump. round 1
  • Largest spread between rounds: Spider web, from 21 to 41 questions. round 1, round 2, round 3
  • 16 wrong guesses in 30 rounds, up to 7 in one round on Spider web. round 2

Failed rounds and format errors

  • Not solved: Bike pump. Question limit reached after 40 questions; scored as 41. round 3
  • Not solved: Spider web. Question limit reached after 40 questions; scored as 41. round 2
  • Not solved: Door handle. Question limit reached after 40 questions; scored as 41. round 1

Subjects

Results by subject.

Failed rounds count as 41 questions. Rank compares this subject's average with the other models in edition 1.1. Select a subject or a round to see the game.

SubjectAverage questionsSubject rankSolvedRounds
Albert Einstein10.339 of 203 of 3
Albert Schweitzer20.678 of 203 of 3
Garfield11.335 of 203 of 3
Achilles9.3314 of 203 of 3
Genghis Khan9.331 of 203 of 3
Bike pump32.678 of 202 of 3
Spider web28.0017 of 202 of 3
Eyebrow15.008 of 203 of 3
Moon9.679 of 203 of 3
Door handle32.0014 of 202 of 3

Runs

Runs of this model.

Each edition ranks only the newest complete run of a model. Earlier runs are not ranked and their details are not published.