Publication

Model summary · Edition 1.1

GPT-6 SolHigh

These results come from one run: 10 fixed subjects, 3 rounds each, a 40-question limit, and reasoning setting high. They do not predict results on other subjects or settings.

This page always shows the model’s newest ranked run.

Every question, answer, guess, and source.

Result

Rank
Rank 10of 20 models
Question score
18.03 Lower is better. 95% confidence interval 16.29 to 19.77.
Rounds solved
30 of 30 0 format errors
Guesser cost per round
$0.0398 Model time 1m 4s.
See how GPT-6 Sol (high) played. All 30 rounds, with every question, answer, guess, and source.

Observations

What stood out in this run.

Counts and ranks from this run only. A subject rank compares this model’s average on that subject with every other model in this edition. Each item links to its rounds.

Best ranks vs other models

Lowest ranks vs other models

Single rounds

  • Fewest questions in a solved round: 7, on Moon. round 2
  • Most questions in a solved round: 40, on Door handle. round 2
  • Largest spread between rounds: Door handle, from 22 to 40 questions. round 1, round 2, round 3
  • 1 wrong guess in 30 rounds, on Eyebrow. round 3

Failed rounds and format errors

Every round was solved, and every reply used the required format.

Subjects

Results by subject.

Failed rounds count as 41 questions. Rank compares this subject's average with the other models in edition 1.1. Select a subject or a round to see the game.

SubjectAverage questionsSubject rankSolvedRounds
Albert Einstein11.3315 of 203 of 3
Albert Schweitzer31.3317 of 203 of 3
Garfield13.0011 of 203 of 3
Achilles9.0013 of 203 of 3
Genghis Khan12.6711 of 203 of 3
Bike pump34.0010 of 203 of 3
Spider web17.006 of 203 of 3
Eyebrow13.335 of 203 of 3
Moon8.332 of 203 of 3
Door handle30.3313 of 203 of 3

Runs

Runs of this model.

Each edition ranks only the newest complete run of a model. Earlier runs are not ranked and their details are not published.