Publication

Model summary · Edition 1.0

Llama 4 MaverickNon Thinking

These results come from one run: 7 fixed subjects, 5 rounds each, a 50-question limit, and reasoning setting none. They do not predict results on other subjects or settings.

This page always shows the model’s newest ranked run.

Every question, answer, guess, and source.

Result

Rank
Rank 18of 18 models
Question score
32.23 Lower is better. 95% confidence interval 26.82 to 37.63.
Rounds solved
17 of 35 0 format errors
Guesser cost per round
$0.0086 Model time 28s.
See how Llama 4 Maverick (non-thinking) played. All 35 rounds, with every question, answer, guess, and source.

Observations

What stood out in this run.

Counts and ranks from this run only. A subject rank compares this model’s average on that subject with every other model in this edition. Each item links to its rounds.

Best ranks vs other models

Lowest ranks vs other models

Single rounds

Failed rounds and format errors

  • Not solved: Albert Einstein. Question limit reached after 50 questions; scored as 51. round 1
  • Not solved: Albert Einstein. Question limit reached after 50 questions; scored as 51. round 4
  • Not solved: Albert Schweitzer. Question limit reached after 50 questions; scored as 51. round 1
  • Not solved: Albert Schweitzer. Question limit reached after 50 questions; scored as 51. round 2
  • Not solved: Albert Schweitzer. Question limit reached after 50 questions; scored as 51. round 3
  • Not solved: Albert Schweitzer. Question limit reached after 50 questions; scored as 51. round 4
  • Not solved: Albert Schweitzer. Question limit reached after 50 questions; scored as 51. round 5
  • Not solved: Stephen King. Question limit reached after 50 questions; scored as 51. round 1
  • Not solved: Stephen King. Question limit reached after 50 questions; scored as 51. round 2
  • Not solved: Stephen King. Question limit reached after 50 questions; scored as 51. round 3
  • Not solved: Stephen King. Question limit reached after 50 questions; scored as 51. round 4
  • Not solved: Stephen King. Question limit reached after 50 questions; scored as 51. round 5
  • Not solved: Garfield. Question limit reached after 50 questions; scored as 51. round 1
  • Not solved: Garfield. Guess not confirmed after 38 questions; scored as 51. round 4
  • Not solved: Achilles. Question limit reached after 50 questions; scored as 51. round 3
  • Not solved: Achilles. Question limit reached after 50 questions; scored as 51. round 4
  • Not solved: Genghis Khan. Question limit reached after 50 questions; scored as 51. round 4
  • Not solved: Genghis Khan. Question limit reached after 50 questions; scored as 51. round 5

Subjects

Results by subject.

Failed rounds count as 51 questions. Rank compares this subject's average with the other models in edition 1.0. Select a subject or a round to see the game.

SubjectAverage questionsSubject rankSolvedRounds
Albert Einstein25.8018 of 183 of 5
Albert Schweitzer51.0018 of 180 of 5
Stephen King51.0018 of 180 of 5
Garfield32.4017 of 183 of 5
Achilles35.0018 of 183 of 5
Genghis Khan27.2017 of 183 of 5
Mario3.202 of 185 of 5

Runs

Runs of this model.

Each edition ranks only the newest complete run of a model. Earlier runs are not ranked and their details are not published.