Model summary · Edition 1.1

Claude Opus 5High

These results come from one run: 10 fixed subjects, 3 rounds each, a 40-question limit, and reasoning setting high. They do not predict results on other subjects or settings.

This page always shows the model’s newest ranked run.

See all 30 rounds → All models

Every question, answer, guess, and source.

Rank: Rank 11of 20 models
Question score: 18.07 Lower is better. 95% confidence interval 16.50 to 19.63.
Rounds solved: 28 of 30 2 format errors
Guesser cost per round: $0.0934 Model time 1m 22s.

See how Claude Opus 5 (high) played. All 30 rounds, with every question, answer, guess, and source.

Observations

What stood out in this run.

Counts and ranks from this run only. A subject rank compares this model’s average on that subject with every other model in this edition. Each item links to its rounds.

Best ranks vs other models

Spider web: 4th of 20 models, average 15.67 questions. round 1, round 2, round 3
Door handle: 5th of 20 models, average 21.67 questions. round 1, round 2, round 3

Lowest ranks vs other models

Garfield: 17th of 20 models, average 20.33 questions. round 1, round 2, round 3
Bike pump: 16th of 20 models, average 40.33 questions. round 1, round 2, round 3

Single rounds

Fewest questions in a solved round: 8, on Achilles. round 3
Most questions in a solved round: 39, on Bike pump. round 1
Largest spread between rounds: Door handle, from 17 to 29 questions. round 1, round 2, round 3
4 wrong guesses in 30 rounds, up to 2 in one round on Bike pump. round 2

Failed rounds and format errors

Not solved: Bike pump. Question limit reached after 40 questions; scored as 41. round 2
Not solved: Bike pump. Too many format errors after 40 questions; scored as 41. round 3
2 format errors in 1 round. Each one before the question limit used a counted turn. Eyebrow round 2

Subjects

Results by subject.

Failed rounds count as 41 questions. Rank compares this subject's average with the other models in edition 1.1. Select a subject or a round to see the game.

Subject	Average questions	Subject rank	Solved	Rounds
Albert Einstein	11.00	12 of 20	3 of 3	10, 13, 10
Albert Schweitzer	24.00	12 of 20	3 of 3	18, 28, 26
Garfield	20.33	17 of 20	3 of 3	13, 24, 24
Achilles	10.00	15 of 20	3 of 3	10, 12, 8
Genghis Khan	11.67	7 of 20	3 of 3	11, 13, 11
Bike pump	40.33	16 of 20	1 of 3	39, not solved, not solved
Spider web	15.67	4 of 20	3 of 3	18, 16, 13
Eyebrow	16.00	9 of 20	3 of 3	11, 19, 18
Moon	10.00	10 of 20	3 of 3	10, 10, 10
Door handle	21.67	5 of 20	3 of 3	29, 19, 17

Runs

Runs of this model.

Each edition ranks only the newest complete run of a model. Earlier runs are not ranked and their details are not published.

Current run in edition 1.1: BX-20260907-B-0003-experimental-M0006-002, completed 8 Sep 2026.
Edition 1.0: rank 3 of 18, question score 12.34. Different rules and subjects, so scores are not comparable across editions.