The Inference Report
The lab announcements today reveal a market consolidating around inference efficiency and agentic workloads, with infrastructure vendors racing to capture the economics of token generation at scale. OpenAI's GPT-5.6 in Kiro targets developer pricing while NVIDIA dominates the infrastructure narrative with four separate announcements around Vera Rubin, Groq 3 LPX, and efficiency metrics, a volume of messaging that signals NVIDIA is defending against both custom silicon competition and the perception that inference is becoming commoditized. The efficiency frame is deliberate: NVIDIA cites 30x more work per watt for agentic systems and 15x token consumption per agent task, anchoring the value proposition to workload intensity rather than raw capability, which matters because it justifies higher infrastructure spend to hyperscalers and AI-native builders. SpaceXAI's adoption of NVIDIA Vera CPUs is the concrete proof point that the agent-centric stack is moving from theoretical to deployed. Elsewhere, AMD's claim about 64 million token contexts on a single MI355X node and IBM's dual-architecture processor for mainframes suggest competing vendors are addressing specific customer constraints rather than chasing NVIDIA's general-purpose dominance. OpenAI's announcement of blocking Russia-origin coordinated inauthentic behavior sits apart from the infrastructure conversation, it's a compliance and trust signal, not a product move, and appears designed to preempt the inevitable scrutiny that comes when your platform scales to state-actor relevance. The absence of major model announcements from Anthropic, Google, or xAI today leaves the field to infrastructure vendors and deployment stories, which reads as a quiet week for frontier capability claims but a loud one for who controls the margin on running inference at production scale.
Sloane Duvall
- How XPUs Meet a World-Class AI Factory
- With Groq 3 LPX in Full Production, NVIDIA Extends Vera Rubin Inference for Agents
- Up to 30x More Work Per Watt: NVIDIA Vera Rubin NVL72 Sets a New Efficiency Standard for AI Agents
- SpaceXAI Adopts NVIDIA Vera CPU to Accelerate Agentic AI at Massive Scale
- NVIDIA Groq 3 LPX Now in Full Production With World-Class Speed for Agentic AI
A curated reference of models from major AI labs, with open/closed weight status, input modalities, and context window size. American labs tend towards closed weights models and Chinese labs tend toward open weights models.
AllenAINone
- AllenAI: Olmo 3 32B ThinkText66K
Amazon- Amazon: Nova 2 LiteTextVisionVideoFiles1M
- Amazon: Nova Premier 1.0TextVision1M
None
Anthropic- Anthropic: Claude Fable 5TextVisionFiles1M
- Anthropic: Claude Haiku 4.5TextVisionFiles200K
- Anthropic: Claude Opus 4.5FilesVisionText200K
- Anthropic: Claude Opus 4.6TextVisionFiles1M
- Anthropic: Claude Opus 4.7TextVisionFiles1M
- Anthropic: Claude Opus 4.7 (Fast)TextVisionFiles1M
- Anthropic: Claude Opus 4.8TextVisionFiles1M
- Anthropic: Claude Opus 4.8 (Fast)TextVisionFiles1M
- Anthropic: Claude Sonnet 4.5TextVisionFiles1M
- Anthropic: Claude Sonnet 4.6TextVisionFiles1M
- Anthropic: Claude Sonnet 5TextVisionFiles1M
- Claude Opus 5TextVisionFiles1M
- Claude Opus 5 (Fast)TextVisionFiles1M
None
Arcee AINone
- Arcee AI: Trinity Large ThinkingText262K
Deep CogitoNone
- Deep Cogito: Cogito v2.1 671BText128K
Google- Google: Gemini 3 Flash PreviewTextVisionFilesAudioVideo1M
- Google: Gemini 3.1 Flash LiteTextVisionVideoFilesAudio1M
- Google: Gemini 3.1 Flash Lite PreviewTextVisionVideoFilesAudio1M
- Google: Gemini 3.1 Pro PreviewAudioFilesVisionTextVideo1M
- Google: Gemini 3.1 Pro Preview Custom ToolsTextAudioVisionVideoFiles1M
- Google: Gemini 3.5 FlashTextVisionVideoFilesAudio1M
- Google: Gemini 3.5 Flash LiteTextVisionVideoFilesAudio1M
- Google: Gemini 3.6 FlashTextVisionVideoFilesAudio1M
- Google: Gemini 3.7 FlashTextVisionVideoFilesAudio1M
- Google: Lyria 3 Clip PreviewTextVision1M
- Google: Lyria 3 Pro PreviewTextVision1M
- Google: Nano Banana (Gemini 2.5 Flash Image)VisionText33K
- Google: Nano Banana 2 (Gemini 3.1 Flash Image Preview)VisionText66K
- Google: Nano Banana 2 (Gemini 3.1 Flash Image)VisionText131K
- Google: Nano Banana 2 Lite (Gemini 3.1 Flash Lite Image)VisionText66K
- Google: Nano Banana Pro (Gemini 3 Pro Image Preview)VisionText66K
- Google: Nano Banana Pro (Gemini 3 Pro Image)VisionText131K
- Google: Gemma 4 26B A4B VisionTextVideo262K
- Google: Gemma 4 31BVisionTextVideo262K
IBMNone
- IBM: Granite 4.0 MicroText131K
- IBM: Granite 4.1 8BText131K
Inception- Inception: Mercury 2Text128K
None
Meta (Muse)- Meta: Muse Spark 1.1TextVisionVideoFilesAudio1M
- Meta: Muse Spark 1.2TextVisionVideoFilesAudio1M
- Meta: Muse Spark 1.2 ContributorTextVisionVideoFilesAudio1M
- Meta: Muse Glimmer 30BTextVision131K
Nous ResearchNone
- Nous: Hermes 4 405BText131K
- Nous: Hermes 4 70BText131K
NVIDIANone
- NVIDIA: Nemotron 3 Nano 30B A3BText262K
- NVIDIA: Nemotron 3 SuperText1M
- NVIDIA: Nemotron 3 UltraText512K
- NVIDIA: Nemotron 3.5 LightningText262K
OpenAI- OpenAI: GPT AudioTextAudio128K
- OpenAI: GPT Audio MiniTextAudio128K
- OpenAI: GPT-5 ImageVisionTextFiles400K
- OpenAI: GPT-5 Image MiniFilesVisionText400K
- OpenAI: GPT-5 ProVisionTextFiles400K
- OpenAI: GPT-5.1VisionTextFiles400K
- OpenAI: GPT-5.1-CodexTextVision400K
- OpenAI: GPT-5.1-Codex-MaxTextVision400K
- OpenAI: GPT-5.1-Codex-MiniVisionText400K
- OpenAI: GPT-5.2FilesVisionText400K
- OpenAI: GPT-5.2 ChatFilesVisionText128K
- OpenAI: GPT-5.2 ProVisionTextFiles400K
- OpenAI: GPT-5.2-CodexTextVision400K
- OpenAI: GPT-5.3-CodexTextVisionFiles400K
- OpenAI: GPT-5.4TextVisionFiles1M
- OpenAI: GPT-5.4 Image 2VisionTextFiles272K
- OpenAI: GPT-5.4 MiniFilesVisionText400K
- OpenAI: GPT-5.4 NanoFilesVisionText400K
- OpenAI: GPT-5.4 ProTextVisionFiles1M
- OpenAI: GPT-5.5FilesVisionText1M
- OpenAI: GPT-5.5 ProFilesVisionText1M
- OpenAI: GPT-5.6 LunaFilesVisionText1M
- OpenAI: GPT-5.6 Luna ProFilesVisionText1M
- OpenAI: GPT-5.6 SolFilesVisionText1M
- OpenAI: GPT-5.6 Sol ProFilesVisionText1M
- OpenAI: GPT-5.6 TerraFilesVisionText1M
- OpenAI: GPT-5.6 Terra ProFilesVisionText1M
None
Perceptron- Perceptron: Perceptron Mk1TextVisionVideo33K
None
Perplexity- Perplexity: Sonar Pro SearchTextVision200K
None
PoolsideNone
- Poolside: Laguna S 2.1Text1M
- Poolside: Laguna XS 2.1Text262K
Reka AINone
- Reka EdgeVisionTextVideo16K
RelaceNone
- Relace: Relace Apply 3Text256K
- Relace: Relace SearchText256K
Thinking MachinesNone
- Thinking Machines: InklingTextVisionAudio1M
- Thinking Machines: Inkling SmallTextVisionAudio1M
xAI- SpaceXAI: Grok 4.20TextVisionFiles2M
- SpaceXAI: Grok 4.20 Multi-AgentTextVisionFiles2M
- SpaceXAI: Grok 4.3TextVisionFiles1M
- SpaceXAI: Grok 4.5TextVisionFiles500K
- SpaceXAI: Grok 4.6TextVisionFiles500K
- SpaceXAI: Grok Build 0.1TextVisionFiles256K
None
Mistral AINone
- Mistral: Devstral 2 2512TextFiles262K
- Mistral: Ministral 3 14B 2512TextVision262K
- Mistral: Ministral 3 3B 2512TextVision131K
- Mistral: Ministral 3 8B 2512TextVision262K
- Mistral: Mistral Large 3 2512TextVisionFiles262K
- Mistral: Mistral Medium 3.5TextVisionFiles262K
- Mistral: Mistral Small 4TextVision262K
- Mistral: Voxtral Small 24B 2507TextAudioFiles32K
Alibaba (Qwen)- Qwen: Qwen3 Coder FlashText1M
- Qwen: Qwen3 Coder PlusText1M
- Qwen: Qwen3 MaxText262K
- Qwen: Qwen3 Max ThinkingText262K
- Qwen: Qwen3.6 FlashTextVisionVideo1M
- Qwen: Qwen3.6 Max PreviewText262K
- Qwen: Qwen3.6 PlusTextVisionVideo1M
- Qwen: Qwen3.7 FlashTextVisionVideo1M
- Qwen: Qwen3.7 MaxText1M
- Qwen: Qwen3.7 PlusTextVision1M
- Qwen: Qwen3 30B A3B Thinking 2507Text82K
- Qwen: Qwen3 Coder NextText262K
- Qwen: Qwen3 Next 80B A3B InstructText262K
- Qwen: Qwen3 Next 80B A3B ThinkingText262K
- Qwen: Qwen3 VL 235B A22B InstructTextVision262K
- Qwen: Qwen3 VL 235B A22B ThinkingTextVision131K
- Qwen: Qwen3 VL 30B A3B InstructTextVision262K
- Qwen: Qwen3 VL 30B A3B ThinkingTextVision262K
- Qwen: Qwen3 VL 32B InstructTextVision131K
- Qwen: Qwen3 VL 8B InstructVisionText262K
- Qwen: Qwen3 VL 8B ThinkingVisionText131K
- Qwen: Qwen3.5 397B A17BTextVisionVideo262K
- Qwen: Qwen3.5-122B-A10BTextVisionVideo262K
- Qwen: Qwen3.5-27BTextVisionVideo262K
- Qwen: Qwen3.5-35B-A3BTextVisionVideo262K
- Qwen: Qwen3.5-9BTextVisionVideo262K
- Qwen: Qwen3.6 27BTextVisionVideo262K
- Qwen: Qwen3.6 35B A3BTextVisionVideo262K
- Qwen: Qwen3.8 2.4T A95BText1M
- Qwen: Qwen3.8 27BTextVisionVideo1M
- Qwen: Qwen3.8 MaxTextVisionVideo1M
ByteDance- Seed: Seed 1.6VisionTextVideo262K
- Seed: Seed 1.6 FlashVisionTextVideo262K
- Seed: Seed 2.1 TurboTextVisionVideo262K
- Seed: Seed-2.0-CodeTextVisionVideo262K
- Seed: Seed-2.0-LiteTextVisionVideo262K
- Seed: Seed-2.0-MiniTextVisionVideo262K
None
DeepSeekNone
- DeepSeek: DeepSeek V3.1 TerminusText164K
- DeepSeek: DeepSeek V3.2Text164K
- DeepSeek: DeepSeek V3.2 ExpText164K
- DeepSeek: DeepSeek V4 Flash 0423Text1M
- DeepSeek: DeepSeek V4 Flash 0731Text1M
- DeepSeek: DeepSeek V4 Flash Vision ExpTextVision1M
- DeepSeek: DeepSeek V4 Pro 0423Text1M
- DeepSeek: DeepSeek V4 Pro 0813Text1M
MiniMax- MiniMax: MiniMax M2-herText66K
- MiniMax: MiniMax M2Text205K
- MiniMax: MiniMax M2.1Text205K
- MiniMax: MiniMax M2.5Text205K
- MiniMax: MiniMax M2.7Text205K
- MiniMax: MiniMax M3TextVisionVideo1M
Moonshot AINone
- MoonshotAI: Kimi K2 0905Text262K
- MoonshotAI: Kimi K2 ThinkingText262K
- MoonshotAI: Kimi K2.5TextVision262K
- MoonshotAI: Kimi K2.6TextVision262K
- MoonshotAI: Kimi K2.7 CodeTextVision262K
- MoonshotAI: Kimi K3TextVisionVideo1M
XiaomiNone
- Xiaomi: MiMo-V2.5TextAudioVisionVideo1M
- Xiaomi: MiMo-V2.5-ProText1M
Z.aiNone
- Z.ai: GLM 4.6Text205K
- Z.ai: GLM 4.6VVisionTextVideo131K
- Z.ai: GLM 4.7Text205K
- Z.ai: GLM 4.7 FlashText203K
- Z.ai: GLM 5Text205K
- Z.ai: GLM 5 TurboText203K
- Z.ai: GLM 5.1Text205K
- Z.ai: GLM 5.2Text1M
- Z.ai: GLM 5.3Text1M
- Z.ai: GLM 5V TurboVisionTextVideo203K
Upstage- Upstage: Solar Pro 3Text131K
- Upstage: Solar Pro 4Text524K
None