The Inference Report

April 6, 2026

Daily rankings from SWE-rebench, a benchmark designed to fairly compare LLM capabilities on real-world software engineering tasks. Unlike other evaluations, it uses a standardized scaffolding for all models, continuously updates its dataset to prevent contamination, and runs each model five times to account for stochastic variance.

#ModelScore
1Claude Opus 4.665.3%
2gpt-5.2-2025-12-11-medium64.4%
3GLM-562.8%
4gpt-5.4-2026-03-05-medium62.8%
5Gemini 3.1 Pro Preview62.3%
6DeepSeek-V3.260.9%
7Claude Sonnet 4.660.7%
8Claude Sonnet 4.560.0%
9Qwen3.5-397B-A17B59.9%
10Step-3.5-Flash59.6%

Artificial Analysis composite index across coding, math, and reasoning benchmarks.

#ModelScoretok/s$/1M
1GPT-5.457.276$5.63
2Gemini 3.1 Pro Preview57.2135$4.50
3GPT-5.3 Codex5484$4.81
4Claude Opus 4.65350$10.00
5Claude Sonnet 4.651.749$6.00
6GPT-5.251.373$4.81
7GLM-549.869$1.55
8Claude Opus 4.549.767$10.00
9MiniMax-M2.749.641$0.525
10MiMo-V2-Pro49.20$1.50

Output tokens per second — higher is faster. Minimum intelligence score of 40.

#Modeltok/s
1Grok 4.20 Beta 0309270
2GPT-5.4 nano208
3Gemini 3 Flash Preview198
4GPT-5 Codex188
5GPT-5.1 Codex180
6GPT-5.4 mini176
7Qwen3.5 122B A10B159
8MiMo-V2-Flash144
9Gemini 3 Pro Preview139
10Gemini 3.1 Pro Preview135

Blended cost per 1M tokens (3:1 input/output) — lower is cheaper. Minimum intelligence score of 40.

#Model$/1M
1MiMo-V2-Flash$0.15
2DeepSeek V3.2$0.315
3GPT-5.4 nano$0.463
4MiniMax-M2.7$0.525
5KAT Coder Pro V2$0.525
6MiniMax-M2.5$0.525
7GPT-5 mini$0.688
8Qwen3.5 27B$0.825
9GLM-4.7$1.00
10Kimi K2 Thinking$1.07