Models
17
Guesser cost range
59×
Pareto-efficient
6 of 17
Most efficient
gpt-oss-120B (high)

Official efficiency ranking

Distance from the lower-left ideal.

Question score and Guesser cost are each scaled from 0 (best among these models) to 1 (worst). The ranking weights both equally and measures the distance from the best possible point. Lower is better.

Distance on the shared scale · lower is betterSelect a model row to view its results
  1. 1. gpt-oss-120B (high): 0.096. 0.078 scaled question score · 0.056 scaled cost. View results for gpt-oss-120B (high)
  2. 2. Claude Opus 5 (high): 0.127. 0.014 scaled question score · 0.126 scaled cost. View results for Claude Opus 5 (high)
  3. 3. Gemini 3.7 Flash (high): 0.151. 0.098 scaled question score · 0.115 scaled cost. View results for Gemini 3.7 Flash (high)
  4. 4. Claude Sonnet 5 (high): 0.157. 0.133 scaled question score · 0.083 scaled cost. View results for Claude Sonnet 5 (high)
  5. 5. Grok 4.6 (high): 0.160. 0.110 scaled question score · 0.115 scaled cost. View results for Grok 4.6 (high)
  6. 6. Grok 4.5 (high): 0.160. 0.154 scaled question score · 0.041 scaled cost. View results for Grok 4.5 (high)
  7. 7. GPT-5 Nano (medium): 0.170. 0.170 scaled question score · 0.011 scaled cost. View results for GPT-5 Nano (medium)
  8. 8. Gemini 3.8 Flash (high): 0.218. 0.054 scaled question score · 0.212 scaled cost. View results for Gemini 3.8 Flash (high)
  9. 9. GPT-5.6 Luna (high): 0.283. 0.282 scaled question score · 0.020 scaled cost. View results for GPT-5.6 Luna (high)
  10. 10. Claude Fable 5 (high): 0.343. 0.000 scaled question score · 0.343 scaled cost. View results for Claude Fable 5 (high)
  11. 11. GPT-5.6 Sol (high): 0.350. 0.116 scaled question score · 0.330 scaled cost. View results for GPT-5.6 Sol (high)
  12. 12. Kimi K3 (high): 0.396. 0.034 scaled question score · 0.395 scaled cost. View results for Kimi K3 (high)
  13. 13. Gemini 3.6 Flash (high): 0.407. 0.239 scaled question score · 0.329 scaled cost. View results for Gemini 3.6 Flash (high)
  14. 14. GPT-6 Astra (high): 0.665. 0.150 scaled question score · 0.648 scaled cost. View results for GPT-6 Astra (high)
  15. 15. Mistral Medium 3.5 (high): 0.908. 0.397 scaled question score · 0.817 scaled cost. View results for Mistral Medium 3.5 (high)
  16. 16. Llama 4 Maverick (non-thinking): 1.000. 1.000 scaled question score · 0.000 scaled cost. View results for Llama 4 Maverick (non-thinking)
  17. 17. Claude Fable 5.1 (high): 1.000. 0.003 scaled question score · 1.000 scaled cost. View results for Claude Fable 5.1 (high)

Trade-off map

Cost and question score on a shared scale.

Both axes use the same 0-to-1 scale. Dashed curves connect points at equal distance from the lower-left corner.

Diamond Pareto-efficient: no other model is both cheaper and better Circle Other ranked model
Lower-left is betterCurves show equal ideal distance. Numbers match the table rank.
  1. gpt-oss-120B (high): 13.63 questions, $0.0363 Guesser cost per round, ideal distance 0.096, rank 1. Pareto-efficient. View results for gpt-oss-120B (high)
  2. Claude Opus 5 (high): 12.34 questions, $0.0705 Guesser cost per round, ideal distance 0.127, rank 2. Pareto-efficient. View results for Claude Opus 5 (high)
  3. Gemini 3.7 Flash (high): 14.03 questions, $0.0653 Guesser cost per round, ideal distance 0.151, rank 3. View results for Gemini 3.7 Flash (high)
  4. Claude Sonnet 5 (high): 14.74 questions, $0.0493 Guesser cost per round, ideal distance 0.157, rank 4. View results for Claude Sonnet 5 (high)
  5. Grok 4.6 (high): 14.29 questions, $0.0653 Guesser cost per round, ideal distance 0.160, rank 5. View results for Grok 4.6 (high)
  6. Grok 4.5 (high): 15.17 questions, $0.0286 Guesser cost per round, ideal distance 0.160, rank 6. Pareto-efficient. View results for Grok 4.5 (high)
  7. GPT-5 Nano (medium): 15.49 questions, $0.0138 Guesser cost per round, ideal distance 0.170, rank 7. Pareto-efficient. View results for GPT-5 Nano (medium)
  8. Gemini 3.8 Flash (high): 13.14 questions, $0.1128 Guesser cost per round, ideal distance 0.218, rank 8. View results for Gemini 3.8 Flash (high)
  9. GPT-5.6 Luna (high): 17.74 questions, $0.0184 Guesser cost per round, ideal distance 0.283, rank 9. View results for GPT-5.6 Luna (high)
  10. Claude Fable 5 (high): 12.06 questions, $0.1776 Guesser cost per round, ideal distance 0.343, rank 10. Pareto-efficient. View results for Claude Fable 5 (high)
  11. GPT-5.6 Sol (high): 14.40 questions, $0.1711 Guesser cost per round, ideal distance 0.350, rank 11. View results for GPT-5.6 Sol (high)
  12. Kimi K3 (high): 12.74 questions, $0.2032 Guesser cost per round, ideal distance 0.396, rank 12. View results for Kimi K3 (high)
  13. Gemini 3.6 Flash (high): 16.89 questions, $0.1705 Guesser cost per round, ideal distance 0.407, rank 13. View results for Gemini 3.6 Flash (high)
  14. GPT-6 Astra (high): 15.09 questions, $0.3279 Guesser cost per round, ideal distance 0.665, rank 14. View results for GPT-6 Astra (high)
  15. Mistral Medium 3.5 (high): 20.06 questions, $0.4113 Guesser cost per round, ideal distance 0.908, rank 15. View results for Mistral Medium 3.5 (high)
  16. Llama 4 Maverick (non-thinking): 32.23 questions, $0.0086 Guesser cost per round, ideal distance 1.000, rank 16. Pareto-efficient. View results for Llama 4 Maverick (non-thinking)
  17. Claude Fable 5.1 (high): 12.11 questions, $0.5014 Guesser cost per round, ideal distance 1.000, rank 17. View results for Claude Fable 5.1 (high)

Expanded trade-off map

Cost and question score on a shared scale.

Lower-left is better. Curves show equal distance from the ideal.

Diamond Pareto-efficient: no other model is both cheaper and better Circle Other ranked model
Efficiency ranking
Ideal-distance rankParetoefficient
Rank 1gpt-oss-120B (high)cerebras0.096 Yes 613.63$0.036394%
Rank 2Claude Opus 5 (high)anthropic0.127 Yes 312.34$0.0705100%
Rank 3Gemini 3.7 Flash (high)google-ai-studio0.151714.03$0.065397%
Rank 4Claude Sonnet 5 (high)anthropic0.1571014.74$0.0493100%
Rank 5Grok 4.6 (high)xai0.160814.29$0.0653100%
Rank 6Grok 4.5 (high)xai0.160 Yes 1215.17$0.028694%
Rank 7GPT-5 Nano (medium)openai0.170 Yes 1315.49$0.013894%
Rank 8Gemini 3.8 Flash (high)google-ai-studio0.218513.14$0.1128100%
Rank 9GPT-5.6 Luna (high)openai0.2831617.74$0.018491%
Rank 10Claude Fable 5 (high)anthropic0.343 Yes 112.06$0.1776100%
Rank 11GPT-5.6 Sol (high)openai0.350914.40$0.1711100%
Rank 12Kimi K3 (high)moonshotai0.396412.74$0.203294%
Rank 13Gemini 3.6 Flash (high)google-vertex0.4071416.89$0.170597%
Rank 14GPT-6 Astra (high)openai0.6651115.09$0.327994%
Rank 15Mistral Medium 3.5 (high)mistral0.9081720.06$0.411389%
Rank 16Llama 4 Maverick (non-thinking)parasail1.000 Yes 1832.23$0.008649%
Rank 17Claude Fable 5.1 (high)anthropic1.000212.11$0.501497%
Rank 1gpt-oss-120B (high)cerebras0.096Ideal distance
Pareto-efficient
Yes
Question score
13.63
Guesser cost / round
$0.0363
Open model results.
Rank 2Claude Opus 5 (high)anthropic0.127Ideal distance
Pareto-efficient
Yes
Question score
12.34
Guesser cost / round
$0.0705
Open model results.
Rank 3Gemini 3.7 Flash (high)google-ai-studio0.151Ideal distance
Pareto-efficient
No
Question score
14.03
Guesser cost / round
$0.0653
Open model results.
Rank 4Claude Sonnet 5 (high)anthropic0.157Ideal distance
Pareto-efficient
No
Question score
14.74
Guesser cost / round
$0.0493
Open model results.
Rank 5Grok 4.6 (high)xai0.160Ideal distance
Pareto-efficient
No
Question score
14.29
Guesser cost / round
$0.0653
Open model results.
Rank 6Grok 4.5 (high)xai0.160Ideal distance
Pareto-efficient
Yes
Question score
15.17
Guesser cost / round
$0.0286
Open model results.
Rank 7GPT-5 Nano (medium)openai0.170Ideal distance
Pareto-efficient
Yes
Question score
15.49
Guesser cost / round
$0.0138
Open model results.
Rank 8Gemini 3.8 Flash (high)google-ai-studio0.218Ideal distance
Pareto-efficient
No
Question score
13.14
Guesser cost / round
$0.1128
Open model results.
Rank 9GPT-5.6 Luna (high)openai0.283Ideal distance
Pareto-efficient
No
Question score
17.74
Guesser cost / round
$0.0184
Open model results.
Rank 10Claude Fable 5 (high)anthropic0.343Ideal distance
Pareto-efficient
Yes
Question score
12.06
Guesser cost / round
$0.1776
Open model results.
Rank 11GPT-5.6 Sol (high)openai0.350Ideal distance
Pareto-efficient
No
Question score
14.40
Guesser cost / round
$0.1711
Open model results.
Rank 12Kimi K3 (high)moonshotai0.396Ideal distance
Pareto-efficient
No
Question score
12.74
Guesser cost / round
$0.2032
Open model results.
Rank 13Gemini 3.6 Flash (high)google-vertex0.407Ideal distance
Pareto-efficient
No
Question score
16.89
Guesser cost / round
$0.1705
Open model results.
Rank 14GPT-6 Astra (high)openai0.665Ideal distance
Pareto-efficient
No
Question score
15.09
Guesser cost / round
$0.3279
Open model results.
Rank 15Mistral Medium 3.5 (high)mistral0.908Ideal distance
Pareto-efficient
No
Question score
20.06
Guesser cost / round
$0.4113
Open model results.
Rank 16Llama 4 Maverick (non-thinking)parasail1.000Ideal distance
Pareto-efficient
Yes
Question score
32.23
Guesser cost / round
$0.0086
Open model results.
Rank 17Claude Fable 5.1 (high)anthropic1.000Ideal distance
Pareto-efficient
No
Question score
12.11
Guesser cost / round
$0.5014
Open model results.

1 model is not ranked because a question score or a Guesser cost above zero is missing.

How it is calculated

Distance from the lowest score and cost.

Both measures use a 0-to-1 scale and have equal weight. Lower is better.

Formula√(scaled question score² + scaled Guesser cost²)
Calculation detailsSteps and limits
  1. Scale question score as (value − lowest) ÷ (highest − lowest) across the compared models.
  2. Scale Guesser cost per round with the same calculation.
  3. Measure straight-line distance from (0, 0). Lower is better.

A model with scaled question score 0.06 and scaled cost 0.08 has distance √(0.06² + 0.08²) = 0.10.

The question score includes the fixed score for failed rounds.

Adding or removing a model can change every scaled value and rank.