Leaderboard
Preference ratings from blind human votes, on an Elo-like scale — cost and speed were never visible to voters.
Claude Fable 5
1728
±196
5/8 picked · $1.04/gen
provisional
Kimi K3
1506
±217
2/10 picked · $0.424/gen
provisional
GPT 5.6 Sol
1475
±182
4/16 picked · $0.305/gen
provisional
| # | Model | Rating | W / L | Votes | Avg cost | Median time |
|---|---|---|---|---|---|---|
| 1 | Claude Fable 5Anthropicprovisional | 1728±196 | 8 | $1.04 | ||
| 2 | Kimi K3Moonshotprovisional | 1506±217 | 10 | $0.424 | ||
| 3 | GPT 5.6 SolOpenAIprovisional | 1475±182 | 16 | $0.305 | ||
| 4 | Claude Opus 5Anthropicprovisional | 1455±413 | 1 | $1.26 | ||
| 5 | GLM 5.2Z.aiprovisional | 1318±233 | 15 | $0.066 |
Ratings come from one preference model fitted to every blind vote at once (Plackett–Luce, on an Elo-like scale where +400 ≈ 10:1 odds). Because it’s fitted globally rather than accumulated vote by vote, a model added later is judged on its own record — not penalised for arriving late. ± is the 95% confidence interval; overlapping intervals mean the gap isn’t established yet. “Provisional” means too few votes to place confidently. W/L is times picked vs times shown. Cost and time are per full generation. ▲/▼ is the 7-day rank move.
Rating vs cost
Up and left is the value frontier — preferred by humans, cheap to run. The leader is highlighted in gold.
Bubble size reflects vote volume.