How it is calculated
CI width.
A smaller CI width means more consistent results across the repeated rounds.
Formula
CI width = upper 95% CI bound − lower 95% CI boundCalculation detailsSteps, example, and limits
- Calculate the model's 95% CI from the spread between repeated rounds of the same subject. Differences between subjects do not widen it.
- Subtract the lower end from the upper end.
- Sort the widths from smallest to largest.
Example, GPT-6 Astra (high): 14.85 − 12.49 = 2.36 questions.
Stable does not mean good. A model that scores poorly but consistently can rank well here. A model with a strong average and a wide CI ranks lower.
This is an approximate measure for these subjects only. It does not predict single rounds and is not a significance test between two models.