Publication

Model summary · Edition 1.1

Claude Haiku 5.5High

These results come from one run: 10 fixed subjects, 3 rounds each, a 40-question limit, and reasoning setting high. They do not predict results on other subjects or settings.

This page always shows the model’s newest ranked run.

Every question, answer, guess, and source.

Result

Rank
Rank 15of 21 models
Question score
20.00 Lower is better. 95% confidence interval 17.10 to 22.90.
Rounds solved
25 of 30 0 format errors
Guesser cost per round
$0.0046 Model time 1m 19s.
See how Claude Haiku 5.5 (high) played. All 30 rounds, with every question, answer, guess, and source.

Observations

What stood out in this run.

Counts and ranks from this run only. A subject rank compares this model’s average on that subject with every other model in this edition. Each item links to its rounds.

Best ranks vs other models

Lowest ranks vs other models

Single rounds

  • Fewest questions in a solved round: 5, on Garfield. round 1
  • Most questions in a solved round: 38, on Spider web. round 2
  • Largest spread between rounds: Albert Schweitzer, from 16 to 41 questions. round 1, round 2, round 3
  • 13 wrong guesses in 30 rounds, up to 3 in one round on Bike pump. round 2

Failed rounds and format errors

  • Not solved: Albert Schweitzer. Too many format errors after 40 questions; scored as 41. round 2
  • Not solved: Bike pump. Too many format errors after 40 questions; scored as 41. round 1
  • Not solved: Bike pump. Too many format errors after 40 questions; scored as 41. round 2
  • Not solved: Door handle. Question limit reached after 40 questions; scored as 41. round 1
  • Not solved: Door handle. Too many format errors after 40 questions; scored as 41. round 2

Subjects

Results by subject.

Failed rounds count as 41 questions. Rank compares this subject's average with the other models in edition 1.1. Select a subject or a round to see the game.

SubjectAverage questionsSubject rankSolvedRounds
Albert Einstein8.333 of 213 of 3
Albert Schweitzer25.3313 of 212 of 3
Garfield7.671 of 213 of 3
Achilles5.671 of 213 of 3
Genghis Khan18.3319 of 213 of 3
Bike pump37.6714 of 211 of 3
Spider web29.6718 of 213 of 3
Eyebrow23.0017 of 213 of 3
Moon8.674 of 213 of 3
Door handle35.6719 of 211 of 3

Runs

Runs of this model.

Each edition ranks only the newest complete run of a model. Earlier runs are not ranked and their details are not published.