Model cost 1.1
- Models
- 21
- Total benchmark cost
- $94.95
- Total Guesser cost
- $45.32
- Answer-checking share
- 52%
Guesser cost
Guesser cost across the run.
Each bar is the provider-reported cost of all Guesser calls in the run. It excludes answer-checking costs and earlier attempts of rounds rerun after a test system failure.
- 1. GLM-5.3-Flash (high): $0.05. View results for GLM-5.3-Flash (high)
- 2. GPT-6 Luna (high): $0.09. View results for GPT-6 Luna (high)
- 3. Claude Haiku 5.5 (high): $0.14. View results for Claude Haiku 5.5 (high)
- 4. Muse Spark 1.3 Contributor (high): $0.15. View results for Muse Spark 1.3 Contributor (high)
- 5. GPT-5.6 Luna (high): $0.19. View results for GPT-5.6 Luna (high)
- 6. MiniMax M3 (high): $0.30. View results for MiniMax M3 (high)
- 7. GPT-6.1 Sol (high): $1.13. View results for GPT-6.1 Sol (high)
- 8. GPT-6 Sol (high): $1.19. View results for GPT-6 Sol (high)
- 9. Grok 4.7 (high): $1.30. View results for Grok 4.7 (high)
- 10. Claude Sonnet 5.5 (high): $1.38. View results for Claude Sonnet 5.5 (high)
- 11. Gemini 3.7 Flash (high): $1.58. View results for Gemini 3.7 Flash (high)
- 12. GPT-5.6 Sol (high): $1.67. View results for GPT-5.6 Sol (high)
- 13. gpt-oss-120B (high): $2.04. View results for gpt-oss-120B (high)
- 14. Claude Opus 5.5 (high): $2.25. View results for Claude Opus 5.5 (high)
- 15. Gemini 3.8 Flash (high): $2.62. View results for Gemini 3.8 Flash (high)
- 16. Claude Opus 5 (high): $2.80. View results for Claude Opus 5 (high)
- 17. Gemini 4 Argon (high): $3.94. View results for Gemini 4 Argon (high)
- 18. Grok 4.6 (high): $4.10. View results for Grok 4.6 (high)
- 19. Muse Wonder (high): $4.82. View results for Muse Wonder (high)
- 20. GPT-6 Astra (high): $5.27. View results for GPT-6 Astra (high)
- 21. Claude Fable 5.1 (high): $8.31. View results for Claude Fable 5.1 (high)
Total benchmark cost
Where the total cost came from.
Bar length shows the total benchmark cost. Colors separate the Guesser, the Oracle, and the other answer checks (Reviewer, Judge, and Validator). Open the exact breakdown to compare those three.
- Guesser
- Oracle
- Other answer checks
Select a model row to view its results.
Exact answer-checking costs
| Model | Reviewer | Judge | Validator |
|---|---|---|---|
| Muse Spark 1.3 Contributor (high) | $0.64 | $0.48 | $0.01 |
| GPT-6 Luna (high) | $0.68 | $0.59 | $0.01 |
| Claude Haiku 5.5 (high) | $0.67 | $0.50 | $0.01 |
| GPT-6.1 Sol (high) | $0.44 | $0.47 | $0.01 |
| GLM-5.3-Flash (high) | $0.69 | $0.58 | $0.01 |
| GPT-6 Sol (high) | $0.55 | $0.58 | $0.01 |
| GPT-5.6 Luna (high) | $0.83 | $0.75 | $0.01 |
| Claude Sonnet 5.5 (high) | $0.55 | $0.53 | $0.01 |
| Gemini 3.7 Flash (high) | $0.60 | $0.42 | $0.01 |
| Claude Opus 5.5 (high) | $0.41 | $0.37 | $0.01 |
| Grok 4.7 (high) | $0.62 | $0.87 | $0.00 |
| GPT-5.6 Sol (high) | $0.67 | $0.54 | $0.01 |
| MiniMax M3 (high) | $0.86 | $1.13 | $0.02 |
| Gemini 3.8 Flash (high) | $0.55 | $0.25 | $0.01 |
| gpt-oss-120B (high) | $0.66 | $0.38 | $0.01 |
| Gemini 4 Argon (high) | $0.41 | $0.26 | $0.01 |
| Claude Opus 5 (high) | $0.60 | $0.72 | $0.01 |
| Grok 4.6 (high) | $0.65 | $0.47 | $0.01 |
| GPT-6 Astra (high) | $0.36 | $0.30 | $0.01 |
| Muse Wonder (high) | $0.56 | $0.70 | $0.01 |
| Claude Fable 5.1 (high) | $0.51 | $0.36 | $0.01 |
- Muse Spark 1.3 Contributor (high): $2.60. Guesser $0.15. Oracle $1.32. Other answer checks $1.13. Reviewer $0.64. Judge $0.48. Validator $0.01. View results for Muse Spark 1.3 Contributor (high)
- GPT-6 Luna (high): $2.63. Guesser $0.09. Oracle $1.26. Other answer checks $1.28. Reviewer $0.68. Judge $0.59. Validator $0.01. View results for GPT-6 Luna (high)
- Claude Haiku 5.5 (high): $2.77. Guesser $0.14. Oracle $1.46. Other answer checks $1.18. Reviewer $0.67. Judge $0.50. Validator $0.01. View results for Claude Haiku 5.5 (high)
- GPT-6.1 Sol (high): $2.87. Guesser $1.13. Oracle $0.83. Other answer checks $0.92. Reviewer $0.44. Judge $0.47. Validator $0.01. View results for GPT-6.1 Sol (high)
- GLM-5.3-Flash (high): $2.88. Guesser $0.05. Oracle $1.55. Other answer checks $1.28. Reviewer $0.69. Judge $0.58. Validator $0.01. View results for GLM-5.3-Flash (high)
- GPT-6 Sol (high): $3.35. Guesser $1.19. Oracle $1.02. Other answer checks $1.13. Reviewer $0.55. Judge $0.58. Validator $0.01. View results for GPT-6 Sol (high)
- GPT-5.6 Luna (high): $3.38. Guesser $0.19. Oracle $1.61. Other answer checks $1.59. Reviewer $0.83. Judge $0.75. Validator $0.01. View results for GPT-5.6 Luna (high)
- Claude Sonnet 5.5 (high): $3.48. Guesser $1.38. Oracle $1.01. Other answer checks $1.09. Reviewer $0.55. Judge $0.53. Validator $0.01. View results for Claude Sonnet 5.5 (high)
- Gemini 3.7 Flash (high): $3.80. Guesser $1.58. Oracle $1.19. Other answer checks $1.03. Reviewer $0.60. Judge $0.42. Validator $0.01. View results for Gemini 3.7 Flash (high)
- Claude Opus 5.5 (high): $3.84. Guesser $2.25. Oracle $0.80. Other answer checks $0.79. Reviewer $0.41. Judge $0.37. Validator $0.01. View results for Claude Opus 5.5 (high)
- Grok 4.7 (high): $4.09. Guesser $1.30. Oracle $1.30. Other answer checks $1.49. Reviewer $0.62. Judge $0.87. Validator $0.00. View results for Grok 4.7 (high)
- GPT-5.6 Sol (high): $4.27. Guesser $1.67. Oracle $1.37. Other answer checks $1.22. Reviewer $0.67. Judge $0.54. Validator $0.01. View results for GPT-5.6 Sol (high)
- MiniMax M3 (high): $4.35. Guesser $0.30. Oracle $2.04. Other answer checks $2.01. Reviewer $0.86. Judge $1.13. Validator $0.02. View results for MiniMax M3 (high)
- Gemini 3.8 Flash (high): $4.52. Guesser $2.62. Oracle $1.09. Other answer checks $0.80. Reviewer $0.55. Judge $0.25. Validator $0.01. View results for Gemini 3.8 Flash (high)
- gpt-oss-120B (high): $4.57. Guesser $2.04. Oracle $1.48. Other answer checks $1.05. Reviewer $0.66. Judge $0.38. Validator $0.01. View results for gpt-oss-120B (high)
- Gemini 4 Argon (high): $5.34. Guesser $3.94. Oracle $0.73. Other answer checks $0.68. Reviewer $0.41. Judge $0.26. Validator $0.01. View results for Gemini 4 Argon (high)
- Claude Opus 5 (high): $5.55. Guesser $2.80. Oracle $1.43. Other answer checks $1.32. Reviewer $0.60. Judge $0.72. Validator $0.01. View results for Claude Opus 5 (high)
- Grok 4.6 (high): $6.56. Guesser $4.10. Oracle $1.34. Other answer checks $1.12. Reviewer $0.65. Judge $0.47. Validator $0.01. View results for Grok 4.6 (high)
- GPT-6 Astra (high): $6.68. Guesser $5.27. Oracle $0.75. Other answer checks $0.67. Reviewer $0.36. Judge $0.30. Validator $0.01. View results for GPT-6 Astra (high)
- Muse Wonder (high): $7.18. Guesser $4.82. Oracle $1.10. Other answer checks $1.27. Reviewer $0.56. Judge $0.70. Validator $0.01. View results for Muse Wonder (high)
- Claude Fable 5.1 (high): $10.22. Guesser $8.31. Oracle $1.03. Other answer checks $0.88. Reviewer $0.51. Judge $0.36. Validator $0.01. View results for Claude Fable 5.1 (high)
| Benchmark cost rank | ||||||
|---|---|---|---|---|---|---|
| Rank 1 | Muse Spark 1.3 Contributor (high) | $0.0049 | $0.0865 | $0.0816 | 94% | $2.60 Rerun cost (excluded): $0.02 |
| Rank 2 | GPT-6 Luna (high) | $0.0031 | $0.0877 | $0.0846 | 96% | $2.63 |
| Rank 3 | Claude Haiku 5.5 (high) | $0.0046 | $0.0925 | $0.0879 | 95% | $2.77 Rerun cost (excluded): $0.20 |
| Rank 4 | GPT-6.1 Sol (high) | $0.0376 | $0.0957 | $0.0581 | 61% | $2.87 Rerun cost (excluded): $0.54 |
| Rank 5 | GLM-5.3-Flash (high) | $0.0016 | $0.0959 | $0.0944 | 98% | $2.88 Rerun cost (excluded): $0.02 |
| Rank 6 | GPT-6 Sol (high) | $0.0398 | $0.1116 | $0.0718 | 64% | $3.35 |
| Rank 7 | GPT-5.6 Luna (high) | $0.0063 | $0.1128 | $0.1065 | 94% | $3.38 Rerun cost (excluded): $0.03 |
| Rank 8 | Claude Sonnet 5.5 (high) | $0.0460 | $0.1160 | $0.0701 | 60% | $3.48 Rerun cost (excluded): $0.37 |
| Rank 9 | Gemini 3.7 Flash (high) | $0.0525 | $0.1267 | $0.0742 | 59% | $3.80 |
| Rank 10 | Claude Opus 5.5 (high) | $0.0751 | $0.1281 | $0.0531 | 41% | $3.84 Rerun cost (excluded): $0.11 |
| Rank 11 | Grok 4.7 (high) | $0.0432 | $0.1364 | $0.0932 | 68% | $4.09 Rerun cost (excluded): $0.11 |
| Rank 12 | GPT-5.6 Sol (high) | $0.0557 | $0.1423 | $0.0865 | 61% | $4.27 Rerun cost (excluded): $0.11 |
| Rank 13 | MiniMax M3 (high) | $0.0100 | $0.1450 | $0.1350 | 93% | $4.35 Rerun cost (excluded): $0.18 |
| Rank 14 | Gemini 3.8 Flash (high) | $0.0875 | $0.1505 | $0.0630 | 42% | $4.52 Rerun cost (excluded): $0.03 |
| Rank 15 | gpt-oss-120B (high) | $0.0682 | $0.1523 | $0.0842 | 55% | $4.57 Rerun cost (excluded): $0.49 |
| Rank 16 | Gemini 4 Argon (high) | $0.1314 | $0.1782 | $0.0468 | 26% | $5.34 Rerun cost (excluded): $0.20 |
| Rank 17 | Claude Opus 5 (high) | $0.0934 | $0.1852 | $0.0917 | 50% | $5.55 Rerun cost (excluded): $0.76 |
| Rank 18 | Grok 4.6 (high) | $0.1367 | $0.2187 | $0.0821 | 38% | $6.56 Rerun cost (excluded): $0.53 |
| Rank 19 | GPT-6 Astra (high) | $0.1756 | $0.2228 | $0.0472 | 21% | $6.68 Rerun cost (excluded): $0.17 |
| Rank 20 | Muse Wonder (high) | $0.1605 | $0.2394 | $0.0789 | 33% | $7.18 Rerun cost (excluded): $0.07 |
| Rank 21 | Claude Fable 5.1 (high) | $0.2772 | $0.3408 | $0.0637 | 19% | $10.22 Rerun cost (excluded): $1.54 |
Rank 1Muse Spark 1.3 Contributor (high)meta$0.0049Guesser cost / round
- Benchmark cost / round
- $0.0865
- Benchmark run cost
- $2.60
- Rerun cost (excluded)
- $0.02
Rank 2GPT-6 Luna (high)openai$0.0031Guesser cost / round
- Benchmark cost / round
- $0.0877
- Benchmark run cost
- $2.63
Rank 3Claude Haiku 5.5 (high)anthropic$0.0046Guesser cost / round
- Benchmark cost / round
- $0.0925
- Benchmark run cost
- $2.77
- Rerun cost (excluded)
- $0.20
Rank 4GPT-6.1 Sol (high)openai$0.0376Guesser cost / round
- Benchmark cost / round
- $0.0957
- Benchmark run cost
- $2.87
- Rerun cost (excluded)
- $0.54
Rank 5GLM-5.3-Flash (high)z-ai$0.0016Guesser cost / round
- Benchmark cost / round
- $0.0959
- Benchmark run cost
- $2.88
- Rerun cost (excluded)
- $0.02
Rank 6GPT-6 Sol (high)openai$0.0398Guesser cost / round
- Benchmark cost / round
- $0.1116
- Benchmark run cost
- $3.35
Rank 7GPT-5.6 Luna (high)openai$0.0063Guesser cost / round
- Benchmark cost / round
- $0.1128
- Benchmark run cost
- $3.38
- Rerun cost (excluded)
- $0.03
Rank 8Claude Sonnet 5.5 (high)anthropic$0.0460Guesser cost / round
- Benchmark cost / round
- $0.1160
- Benchmark run cost
- $3.48
- Rerun cost (excluded)
- $0.37
Rank 9Gemini 3.7 Flash (high)google-ai-studio$0.0525Guesser cost / round
- Benchmark cost / round
- $0.1267
- Benchmark run cost
- $3.80
Rank 10Claude Opus 5.5 (high)anthropic$0.0751Guesser cost / round
- Benchmark cost / round
- $0.1281
- Benchmark run cost
- $3.84
- Rerun cost (excluded)
- $0.11
Rank 11Grok 4.7 (high)xai$0.0432Guesser cost / round
- Benchmark cost / round
- $0.1364
- Benchmark run cost
- $4.09
- Rerun cost (excluded)
- $0.11
Rank 12GPT-5.6 Sol (high)openai$0.0557Guesser cost / round
- Benchmark cost / round
- $0.1423
- Benchmark run cost
- $4.27
- Rerun cost (excluded)
- $0.11
Rank 13MiniMax M3 (high)coreweave$0.0100Guesser cost / round
- Benchmark cost / round
- $0.1450
- Benchmark run cost
- $4.35
- Rerun cost (excluded)
- $0.18
Rank 14Gemini 3.8 Flash (high)google-ai-studio$0.0875Guesser cost / round
- Benchmark cost / round
- $0.1505
- Benchmark run cost
- $4.52
- Rerun cost (excluded)
- $0.03
Rank 15gpt-oss-120B (high)cerebras$0.0682Guesser cost / round
- Benchmark cost / round
- $0.1523
- Benchmark run cost
- $4.57
- Rerun cost (excluded)
- $0.49
Rank 16Gemini 4 Argon (high)google-vertex$0.1314Guesser cost / round
- Benchmark cost / round
- $0.1782
- Benchmark run cost
- $5.34
- Rerun cost (excluded)
- $0.20
Rank 17Claude Opus 5 (high)anthropic$0.0934Guesser cost / round
- Benchmark cost / round
- $0.1852
- Benchmark run cost
- $5.55
- Rerun cost (excluded)
- $0.76
Rank 18Grok 4.6 (high)xai$0.1367Guesser cost / round
- Benchmark cost / round
- $0.2187
- Benchmark run cost
- $6.56
- Rerun cost (excluded)
- $0.53
Rank 19GPT-6 Astra (high)openai$0.1756Guesser cost / round
- Benchmark cost / round
- $0.2228
- Benchmark run cost
- $6.68
- Rerun cost (excluded)
- $0.17
Rank 20Muse Wonder (high)meta$0.1605Guesser cost / round
- Benchmark cost / round
- $0.2394
- Benchmark run cost
- $7.18
- Rerun cost (excluded)
- $0.07
Rank 21Claude Fable 5.1 (high)anthropic$0.2772Guesser cost / round
- Benchmark cost / round
- $0.3408
- Benchmark run cost
- $10.22
- Rerun cost (excluded)
- $1.54
Costs are as reported by the providers for the selected official runs. Earlier attempts of rounds rerun after a test system failure are excluded. A missing provider price can affect the comparison.