The Inference Report
OpenAI is consolidating infrastructure and security while building evaluation frameworks around real-world utility, a posture that combines defensive hardening with expansion into developer tooling and grid integration. The company announced Pando, a Git backend engineered for the scale Codex generates, alongside Grid Protectors to embed itself into utility planning for future compute campuses, both moves that lock in operational dependencies. Security spending increased through higher bug bounties and an internal sprint with Cathedral Systems, signaling recognition that scale attracts adversaries. LifeVal, a benchmark for everyday task completion, reframes the competition away from abstract capability metrics toward what actually matters to users and enterprises. Meanwhile, Google DeepMind is targeting government planning workflows, NVIDIA is positioning physical and agentic AI for municipal infrastructure, and AMD is grinding through optimization work, Stable Diffusion inference on Ryzen AI, diffusion scaling across RDNA 4, memory scheduling on MI300X, the unglamorous work of making models run on consumer and mid-tier hardware. Hugging Face's integration contracts announcement lacks detail but signals vendor lock-in concerns in the model distribution layer. Anthropic's provable inference work stands apart, a theoretical contribution that doesn't announce a product or commercial push. The pattern across these thirteen announcements is specialization by layer: OpenAI building developer-facing integrations and grid relationships, AMD and NVIDIA optimizing inference on their respective silicon, and smaller players either focusing on safety primitives or waiting for integration clarity.
Sloane Duvall
A curated reference of models from major AI labs, with open/closed weight status, input modalities, and context window size. American labs tend towards closed weights models and Chinese labs tend toward open weights models.
AllenAINone
- AllenAI: Olmo 3 32B ThinkText66K
Amazon- Amazon: Nova 2 LiteTextVisionVideoFiles1M
None
Anthropic- Anthropic: Claude Haiku 5.5TextVisionFiles1M
- Anthropic: Claude Opus 4.5FilesVisionText200K
- Anthropic: Claude Opus 4.6TextVisionFiles1M
- Anthropic: Claude Opus 4.7TextVisionFiles1M
- Anthropic: Claude Opus 4.8TextVisionFiles1M
- Anthropic: Claude Opus 5TextVisionFiles1M
- Anthropic: Claude Opus 5.5TextVisionFiles1M
- Anthropic: Claude Sonnet 4.6TextVisionFiles1M
- Anthropic: Claude Sonnet 5TextVisionFiles1M
- Anthropic: Claude Sonnet 5.5TextVisionFiles1M
None
Arcee AINone
- Arcee AI: Trinity Large ThinkingText262K
Deep CogitoNone
- Deep Cogito: Cogito v2.1 671BText128K
Google- Google: Gemini 3 Flash PreviewTextVisionFilesAudioVideo1M
- Google: Gemini 3.1 Flash LiteTextVisionVideoFilesAudio1M
- Google: Gemini 3.1 Pro PreviewAudioFilesVisionTextVideo1M
- Google: Gemini 3.5 FlashTextVisionVideoFilesAudio1M
- Google: Gemini 3.5 Flash LiteTextVisionVideoFilesAudio1M
- Google: Gemini 3.6 FlashTextVisionVideoFilesAudio1M
- Google: Gemini 3.7 FlashTextVisionVideoFilesAudio1M
- Google: Gemini 3.8 FlashTextVisionVideoFilesAudio1M
- Google: Gemini 4 ArgonAudioFilesVisionTextVideo1M
- Google: Nano Banana 2 (Gemini 3.1 Flash Image)VisionText131K
- Google: Nano Banana 2 Lite (Gemini 3.1 Flash Lite Image)VisionText66K
- Google: Nano Banana Pro (Gemini 3 Pro Image)VisionText66K
- Google: Gemma 4 26B A4B VisionTextVideo262K
- Google: Gemma 4 31BVisionTextVideo262K
IBMNone
- IBM: Granite 4.2 8BText131K
Inception- Inception: Mercury 2Text128K
- Inception: Mercury 2.5Text260K
- Inception: Mercury 3Text1M
None
Meta (Muse)None
- Meta: Muse Glimmer 30BTextVision131K
- Meta: Muse Spark OpenTextVisionVideoFilesAudio1M
NVIDIANone
- NVIDIA: Nemotron 3 Nano 30B A3BText262K
- NVIDIA: Nemotron 3 SuperText1M
- NVIDIA: Nemotron 3 UltraText262K
- NVIDIA: Nemotron 3.5 LightningText262K
- NVIDIA: Nemotron 3.5 Super VLTextVisionVideo1M
- NVIDIA: SwitchyardText1M
OpenAI- OpenAI: GPT-5.1VisionTextFiles400K
- OpenAI: GPT-5.1-CodexTextVision400K
- OpenAI: GPT-5.1-Codex-MaxTextVision400K
- OpenAI: GPT-5.1-Codex-MiniVisionText400K
- OpenAI: GPT-5.2FilesVisionText400K
- OpenAI: GPT-5.2-CodexTextVision400K
- OpenAI: GPT-5.3-CodexTextVisionFiles400K
- OpenAI: GPT-5.4TextVisionFiles1M
- OpenAI: GPT-5.4 MiniFilesVisionText400K
- OpenAI: GPT-5.4 NanoFilesVisionText400K
- OpenAI: GPT-5.4 ProTextVisionFiles1M
- OpenAI: GPT-5.5FilesVisionText1M
- OpenAI: GPT-5.6 LunaFilesVisionText1M
- OpenAI: GPT-5.6 Luna ProFilesVisionText1M
- OpenAI: GPT-5.6 SolFilesVisionText1M
- OpenAI: GPT-5.6 Sol ProFilesVisionText1M
- OpenAI: GPT-5.6 TerraFilesVisionText1M
- OpenAI: GPT-5.6 Terra ProFilesVisionText1M
- OpenAI: GPT-6 AstraFilesVisionText1M
- OpenAI: GPT-6 Astra ProFilesVisionText1M
- OpenAI: GPT-6 LunaFilesVisionText1M
- OpenAI: GPT-6 Luna ProFilesVisionText1M
- OpenAI: GPT-6 SolFilesVisionText1M
- OpenAI: GPT-6 Sol ProFilesVisionText1M
- OpenAI: GPT-6.1 SolFilesVisionText1M
- OpenAI: GPT-6.1 Sol ProFilesVisionText1M
- OpenAI: GPT-6.1 TerraFilesVisionText1M
- OpenAI: GPT-6.1 Terra ProFilesVisionText1M
None
Perceptron- Perceptron: Perceptron Mk1TextVisionVideo33K
- Perceptron: Perceptron Mk1.5TextVisionVideoAudio37K
None
PoolsideNone
- Poolside: Laguna S 2.1Text1M
- Poolside: Laguna XS 2.1Text262K
Reka AINone
- Reka EdgeVisionTextVideo16K
RelaceNone
- Relace: Relace SearchText256K
Thinking MachinesNone
- Thinking Machines: InklingTextVisionAudio524K
- Thinking Machines: Inkling SmallTextVisionAudio524K
xAI- SpaceXAI: Grok 4.20TextVisionFiles2M
- SpaceXAI: Grok 4.20 Multi-AgentTextVisionFiles2M
- SpaceXAI: Grok 4.3TextVisionFiles1M
- SpaceXAI: Grok 4.5TextVisionFiles500K
- SpaceXAI: Grok 4.6TextVisionFiles500K
- SpaceXAI: Grok 4.7TextVisionFiles500K
- SpaceXAI: Grok Build 0.1TextVisionFiles256K
None
Cohere- Cohere: Command A+TextVision192K
None
Mistral AINone
- Mistral: Devstral 2 2512TextFiles262K
- Mistral: Ministral 3 14B 2512TextVision262K
- Mistral: Ministral 3 3B 2512TextVision131K
- Mistral: Ministral 3 8B 2512TextVision262K
- Mistral: Mistral Large 3 2512TextVisionFiles262K
- Mistral: Mistral Large 4TextVision1M
- Mistral: Mistral Medium 3.5TextVisionFiles262K
- Mistral: Mistral Small 4TextVision262K
Alibaba (Qwen)None
- Qwen: Qwen3 Coder NextText262K
- Qwen: Qwen3.5 397B A17BTextVisionVideo262K
- Qwen: Qwen3.5-122B-A10BTextVisionVideo262K
- Qwen: Qwen3.5-27BTextVisionVideo262K
- Qwen: Qwen3.5-35B-A3BTextVisionVideo262K
- Qwen: Qwen3.5-9BTextVisionVideo262K
- Qwen: Qwen3.6 27BTextVisionVideo262K
- Qwen: Qwen3.6 35B A3BTextVisionVideo262K
- Qwen: Qwen3.8 2.4T A95BText1M
- Qwen: Qwen3.8 27BTextVisionVideo1M
ByteDance- Seed: Seed 1.6VisionTextVideo262K
- Seed: Seed 1.6 FlashVisionTextVideo262K
- Seed: Seed 2.1 TurboTextVisionVideo262K
- Seed: Seed-2.0-CodeTextVisionVideo262K
- Seed: Seed-2.0-LiteTextVisionVideo262K
- Seed: Seed-2.0-MiniTextVisionVideo262K
None
DeepSeekNone
- DeepSeek: DeepSeek V3.2Text164K
- DeepSeek: DeepSeek V4 Flash 0423Text1M
- DeepSeek: DeepSeek V4 Flash 0731Text1M
- DeepSeek: DeepSeek V4 Flash Vision ExpTextVision1M
- DeepSeek: DeepSeek V4 Pro 0423Text1M
- DeepSeek: DeepSeek V4 Pro 0813Text1M
- DeepSeek: DeepSeek V4.1 FlashTextVision1M
- DeepSeek: DeepSeek V4.1 Flash 1017TextVision1M
MiniMaxNone
- MiniMax: MiniMax M2.5Text198K
- MiniMax: MiniMax M2.7Text197K
- MiniMax: MiniMax M3TextVisionVideo1M
- MiniMax: MiniMax M3.1 FlashTextVisionVideo1M
Moonshot AINone
- MoonshotAI: Kimi K2.5TextVision262K
- MoonshotAI: Kimi K2.6TextVision262K
- MoonshotAI: Kimi K2.7 CodeTextVision262K
- MoonshotAI: Kimi K3TextVisionVideo1M
- MoonshotAI: Kimi K3.1 ProTextVisionVideo1M
XiaomiNone
- Xiaomi: MiMo-V2.5TextAudioVisionVideo1M
- Xiaomi: MiMo-V2.5-ProText262K
- Xiaomi: MiMo-V2.6-FlashTextVisionVideoAudio1M
- Xiaomi: MiMo-V2.6-ProTextVisionVideoAudio1M
Z.aiNone
- Z.ai: GLM 4.6VVisionTextVideo131K
- Z.ai: GLM 4.7Text205K
- Z.ai: GLM 4.7 FlashText200K
- Z.ai: GLM 5Text205K
- Z.ai: GLM 5 TurboText203K
- Z.ai: GLM 5.1Text205K
- Z.ai: GLM 5.2Text1M
- Z.ai: GLM 5.3Text1M
- Z.ai: GLM 5.3 FlashTextVisionVideo1M
- Z.ai: GLM 5.3 FlashXTextVisionVideo1M
- Z.ai: GLM 5.3 FlashX LegalTextVisionVideo1M
- Z.ai: GLM 5V TurboVisionTextVideo203K
Upstage- Upstage: Solar Mini 4Text524K
- Upstage: Solar Pro 4Text524K
None