The Inference Report

October 25, 2026

Daily rankings from SWE-rebench, a benchmark designed to fairly compare LLM capabilities on real-world software engineering tasks. Unlike other evaluations, it uses a standardized scaffolding for all models, continuously updates its dataset to prevent contamination, and runs each model five times to account for stochastic variance.

#ModelScore
1AnthropicFable 5 [high]Model64.5%± 1.41%
2GrokGrok 4.5 [high]Model63.8%± 0.60%
3AnthropicOpus 5 [high]Model63.4%± 1.35%
4Z.aiGLM-5.2 [high]Model62.9%± 1.19%
5OpenAIGPT-5.6 Sol [medium]Model62.3%± 1.83%
6JunieJunieAgent61.8%± 0.54%
7AnthropicClaude CodeAgent60.4%± 1.03%
8OpenAICodexAgent58.0%± 1.29%
9AnthropicSonnet 5 [high]Model56.8%± 0.94%
10CursorCursorAgent51.7%± 0.84%

Artificial Analysis composite index across coding, math, and reasoning benchmarks.

#ModelScoretok/s$/1M
1Claude Opus 5.557.695$8.00
2Claude Sonnet 5.556139$4.00
3Muse Wonder Full55.80$0.00
4Kimi K3.1 Pro55.152$4.00
5Claude Fable 5.153.468$20.00
6GPT-6 Astra52.760$20.00
7Gemini 4 Argon52.679$4.00
8Muse Wonder52.4131$8.00
9GPT-6.1 Sol51.856$4.00
10Claude Opus 550.80$10.00

Output tokens per second — higher is faster. Minimum intelligence score of 40.

#Modeltok/s
1Claude Haiku 5.5242
2Step 5 Preview217
3Ling 3.1 Flash216
4DeepSeek V4.1 Flash 1017159
5Claude Sonnet 5.5139
6Muse Wonder131
7Gemini 3.8 Flash127
8GPT-5.6 Terra122
9MiniMax-M3.1-Flash115
10Claude Opus 5.595

Blended cost per 1M tokens (3:1 input/output) — lower is cheaper. Minimum intelligence score of 40.

#Model$/1M
1Claude Haiku 5.5$0.20
2GLM-5.3-Flash$0.237
3MiniMax-M3.1-Flash$0.262
4Ling 3.1 Flash 1019$0.45
5Ling 3.1 Flash$0.45
6DeepSeek V4.1 Flash 1017$0.525
7MiMo-V2.6-Pro$0.544
8Step 5 Preview$1.43
9Gemini 3.8 Flash$1.50
10Muse Spark 1.3$2.00