Publication

Model summary · Edition 1.0

Mistral Medium 3.5High

These results come from one run: 7 fixed subjects, 5 rounds each, a 50-question limit, and reasoning setting high. They do not predict results on other subjects or settings.

This page always shows the model’s newest ranked run.

Every question, answer, guess, and source.

Result

Rank
Rank 17of 18 models
Question score
20.06 Lower is better. 95% confidence interval 16.11 to 24.01.
Rounds solved
31 of 35 2 format errors
Guesser cost per round
$0.4113 Model time 14m 32s.
See how Mistral Medium 3.5 (high) played. All 35 rounds, with every question, answer, guess, and source.

Observations

What stood out in this run.

Counts and ranks from this run only. A subject rank compares this model’s average on that subject with every other model in this edition. Each item links to its rounds.

Best ranks vs other models

Lowest ranks vs other models

Single rounds

Failed rounds and format errors

  • Not solved: Albert Schweitzer. Question limit reached after 50 questions; scored as 51. round 1
  • Not solved: Albert Schweitzer. Question limit reached after 50 questions; scored as 51. round 3
  • Not solved: Genghis Khan. Question limit reached after 50 questions; scored as 51. round 3
  • Not solved: Mario. Question limit reached after 50 questions; scored as 51. round 4
  • 2 format errors in 1 round. Each one before the question limit used a counted turn. Mario round 4

Subjects

Results by subject.

Failed rounds count as 51 questions. Rank compares this subject's average with the other models in edition 1.0. Select a subject or a round to see the game.

SubjectAverage questionsSubject rankSolvedRounds
Albert Einstein12.2015 of 185 of 5
Albert Schweitzer42.6016 of 183 of 5
Stephen King16.8011 of 185 of 5
Garfield11.203 of 185 of 5
Achilles8.609 of 185 of 5
Genghis Khan31.6018 of 184 of 5
Mario17.4018 of 184 of 5

Runs

Runs of this model.

Each edition ranks only the newest complete run of a model. Earlier runs are not ranked and their details are not published.