The Inference Report

August 20, 2026

Daily rankings from SWE-rebench, a benchmark designed to fairly compare LLM capabilities on real-world software engineering tasks. Unlike other evaluations, it uses a standardized scaffolding for all models, continuously updates its dataset to prevent contamination, and runs each model five times to account for stochastic variance.

#ModelScore
1AnthropicFable 5 [high]Model64.5%± 1.41%
2GrokGrok 4.5 [high]Model63.8%± 0.60%
3AnthropicOpus 5 [high]Model63.4%± 1.35%
4Z.aiGLM-5.2 [high]Model62.9%± 1.19%
5OpenAIGPT-5.6 Sol [medium]Model62.3%± 1.83%
6JunieJunieAgent61.8%± 0.54%
7AnthropicClaude CodeAgent60.4%± 1.03%
8OpenAICodexAgent58.0%± 1.29%
9AnthropicSonnet 5 [high]Model56.8%± 0.94%
10CursorCursorAgent51.7%± 0.84%

Artificial Analysis composite index across coding, math, and reasoning benchmarks.

#ModelScoretok/s$/1M
1Claude Opus 563.154$10.00
2Claude Fable 562.167$20.00
3GPT-5.6 Sol60.969$11.25
4Grok 4.660.966$3.00
5Kimi K359.739$6.00
6GLM-5.359.580$2.15
7Qwen3.8 Max58.147$3.00
8Qwen3.8 2.4T A95B57.747$3.00
9Claude Opus 4.857.30$10.00
10Muse Spark 1.256.80$2.00

Output tokens per second — higher is faster. Minimum intelligence score of 40.

#Modeltok/s
1Gemini 3.7 Flash339
2Gemini 3.6 Flash187
3GPT-5.6 Luna165
4Nex-N2-Pro140
5GPT-5.3 Codex132
6Gemini 3.1 Pro Preview126
7GPT-5.6 Terra117
8DeepSeek V4 Flash 0731115
9MiniMax-M3104
10Claude Sonnet 582

Blended cost per 1M tokens (3:1 input/output) — lower is cheaper. Minimum intelligence score of 40.

#Model$/1M
1DeepSeek V4 Flash$0.168
2Hy3$0.241
3GPT-5.6 Luna$0.45
4MiniMax-M3$0.525
5Solar Pro 4$0.525
6Inkling Small$0.525
7DeepSeek V4 Pro$0.544
8MiMo-V2.5-Pro$0.544
9DeepSeek V4 Flash 0731$0.66
10Nex-N2-Pro$1.00