Model summary · Edition 1.0
Mistral Medium 3.5High
These results come from one run: 7 fixed subjects, 5 rounds each, a 50-question limit, and reasoning setting high. They do not predict results on other subjects or settings.
This page always shows the model’s newest ranked run.
Every question, answer, guess, and source.
Result
- Rank
- Rank 17of 18 models
- Question score
- 20.06 Lower is better. 95% confidence interval 16.11 to 24.01.
- Rounds solved
- 31 of 35 2 format errors
- Guesser cost per round
- $0.4113 Model time 14m 32s.
Observations
What stood out in this run.
Counts and ranks from this run only. A subject rank compares this model’s average on that subject with every other model in this edition. Each item links to its rounds.
Best ranks vs other models
Lowest ranks vs other models
Single rounds
- Fewest questions in a solved round: 6, on Mario. round 3
- Most questions in a solved round: 47, on Albert Schweitzer. round 2
- Largest spread between rounds: Mario, from 6 to 51 questions. round 1, round 2, round 3, round 4, round 5
- 155 wrong guesses in 35 rounds, up to 30 in one round on Albert Schweitzer. round 1
Failed rounds and format errors
- Not solved: Albert Schweitzer. Question limit reached after 50 questions; scored as 51. round 1
- Not solved: Albert Schweitzer. Question limit reached after 50 questions; scored as 51. round 3
- Not solved: Genghis Khan. Question limit reached after 50 questions; scored as 51. round 3
- Not solved: Mario. Question limit reached after 50 questions; scored as 51. round 4
- 2 format errors in 1 round. Each one before the question limit used a counted turn. Mario round 4
Subjects
Results by subject.
Failed rounds count as 51 questions. Rank compares this subject's average with the other models in edition 1.0. Select a subject or a round to see the game.
| Subject | Average questions | Subject rank | Solved | Rounds |
|---|---|---|---|---|
| Albert Einstein | 12.20 | 15 of 18 | 5 of 5 | 14, 7, 19, 9, 12 |
| Albert Schweitzer | 42.60 | 16 of 18 | 3 of 5 | not solved, 47, not solved, 32, 32 |
| Stephen King | 16.80 | 11 of 18 | 5 of 5 | 30, 12, 11, 13, 18 |
| Garfield | 11.20 | 3 of 18 | 5 of 5 | 8, 18, 15, 8, 7 |
| Achilles | 8.60 | 9 of 18 | 5 of 5 | 8, 7, 9, 11, 8 |
| Genghis Khan | 31.60 | 18 of 18 | 4 of 5 | 37, 15, not solved, 38, 17 |
| Mario | 17.40 | 18 of 18 | 4 of 5 | 17, 7, 6, not solved, 6 |
Runs
Runs of this model.
Each edition ranks only the newest complete run of a model. Earlier runs are not ranked and their details are not published.
- Current run in edition 1.0: BX-20260729-official-M0012-011, completed .