The Inference Report
OpenAI is consolidating its position as the primary vendor of production AI agents by shipping GPT-5.5 directly into Codex, its application layer for knowledge work automation, while simultaneously ensuring that layer runs on NVIDIA's infrastructure. The move is revealing: rather than compete on model weights alone, OpenAI is bundling model capability with workflow orchestration, automations, plugins, skills, and structured task execution, which creates friction for customers to migrate. NVIDIA's public embrace of Codex running on GB200 systems signals that the infrastructure vendor sees agent frameworks as the real margin driver, not just raw compute. Meanwhile, Google DeepMind's work on distributed training resilience and Anthropic's partnership with NEC to build engineering capacity in Japan suggest the field is past the phase of proving model capability and into the phase of scaling production deployment and workforce alignment. Hugging Face's focus on browser-based transformer inference via Chrome extensions points toward a different vector: moving model execution to the edge and away from centralized inference, which could fragment the cloud-based agent stack that OpenAI and NVIDIA are building. The announcements collectively reveal a market sorting into layers, model vendors securing inference infrastructure partnerships, application vendors building stickiness through workflow automation, and infrastructure players ensuring they own the hardware dependency, with competition happening at integration points, not at the model level alone.
Sloane Duvall
A curated reference of models from major AI labs, with open/closed weight status, input modalities, and context window size. American labs tend towards closed weights models and Chinese labs tend toward open weights models.
Amazon- Amazon: Nova 2 LiteTextVisionVideoFiles1M
- Amazon: Nova Premier 1.0TextVision1M
None
Anthropic- Anthropic: Claude Haiku 4.5VisionText200K
- Anthropic: Claude Opus 4VisionTextFiles200K
- Anthropic: Claude Opus 4.1VisionTextFiles200K
- Anthropic: Claude Opus 4.5FilesVisionText200K
- Anthropic: Claude Opus 4.6TextVision1M
- Anthropic: Claude Opus 4.6 (Fast)TextVision1M
- Anthropic: Claude Opus 4.7TextVision1M
- Anthropic: Claude Sonnet 4VisionTextFiles1M
- Anthropic: Claude Sonnet 4.5TextVisionFiles1M
- Anthropic: Claude Sonnet 4.6TextVision1M
None
Google DeepMind- Google: Gemini 2.5 FlashFilesVisionTextAudioVideo1M
- Google: Gemini 2.5 Flash LiteTextVisionFilesAudioVideo1M
- Google: Gemini 2.5 Flash Lite Preview 09-2025TextVisionFilesAudioVideo1M
- Google: Gemini 2.5 ProTextVisionFilesAudioVideo1M
- Google: Gemini 2.5 Pro Preview 05-06TextVisionFilesAudioVideo1M
- Google: Gemini 2.5 Pro Preview 06-05FilesVisionTextAudio1M
- Google: Gemini 3 Flash PreviewTextVisionFilesAudioVideo1M
- Google: Gemini 3.1 Flash Lite PreviewTextVisionVideoFilesAudio1M
- Google: Gemini 3.1 Pro PreviewAudioFilesVisionTextVideo1M
- Google: Gemini 3.1 Pro Preview Custom ToolsTextAudioVisionVideoFiles1M
- Google: Lyria 3 Clip PreviewTextVision1M
- Google: Lyria 3 Pro PreviewTextVision1M
- Google: Nano Banana (Gemini 2.5 Flash Image)VisionText33K
- Google: Nano Banana 2 (Gemini 3.1 Flash Image Preview)VisionText66K
- Google: Nano Banana Pro (Gemini 3 Pro Image Preview)VisionText66K
- Google: Gemma 3n 4BText33K
- Google: Gemma 4 26B A4B VisionTextVideo262K
- Google: Gemma 4 31BVisionTextVideo262K
MetaNone
- Meta: Llama Guard 4 12BVisionText164K
OpenAI- OpenAI: GPT AudioTextAudio128K
- OpenAI: GPT Audio MiniTextAudio128K
- OpenAI: GPT-4o AudioAudioText128K
- OpenAI: GPT-5TextVisionFiles400K
- OpenAI: GPT-5 ChatFilesVisionText128K
- OpenAI: GPT-5 CodexTextVision400K
- OpenAI: GPT-5 ImageVisionTextFiles400K
- OpenAI: GPT-5 Image MiniFilesVisionText400K
- OpenAI: GPT-5 MiniTextVisionFiles400K
- OpenAI: GPT-5 NanoTextVisionFiles400K
- OpenAI: GPT-5 ProVisionTextFiles400K
- OpenAI: GPT-5.1VisionTextFiles400K
- OpenAI: GPT-5.1 ChatFilesVisionText128K
- OpenAI: GPT-5.1-CodexTextVision400K
- OpenAI: GPT-5.1-Codex-MaxTextVision400K
- OpenAI: GPT-5.1-Codex-MiniVisionText400K
- OpenAI: GPT-5.2FilesVisionText400K
- OpenAI: GPT-5.2 ChatFilesVisionText128K
- OpenAI: GPT-5.2 ProVisionTextFiles400K
- OpenAI: GPT-5.2-CodexTextVision400K
- OpenAI: GPT-5.3 ChatTextVisionFiles128K
- OpenAI: GPT-5.3-CodexTextVisionFiles400K
- OpenAI: GPT-5.4TextVisionFiles1M
- OpenAI: GPT-5.4 Image 2VisionTextFiles272K
- OpenAI: GPT-5.4 MiniFilesVisionText400K
- OpenAI: GPT-5.4 NanoFilesVisionText400K
- OpenAI: GPT-5.4 ProTextVisionFiles1M
- OpenAI: o3 Deep ResearchVisionTextFiles200K
- OpenAI: o3 ProTextFilesVision200K
- OpenAI: o4 Mini Deep ResearchFilesVisionText200K
- OpenAI: gpt-oss-120bText131K
- OpenAI: gpt-oss-20bText131K
- OpenAI: gpt-oss-safeguard-20bText131K
xAI- xAI: Grok 3Text131K
- xAI: Grok 3 MiniText131K
- xAI: Grok 4VisionTextFiles256K
- xAI: Grok 4 FastTextVisionFiles2M
- xAI: Grok 4.1 FastTextVisionFiles2M
- xAI: Grok 4.20TextVisionFiles2M
- xAI: Grok 4.20 Multi-AgentTextVisionFiles2M
- xAI: Grok Code Fast 1Text256K
None
Mistral AI- Mistral: Codestral 2508Text256K
- Mistral: Devstral MediumText131K
- Mistral: Mistral Large 3 2512TextVision262K
- Mistral: Mistral Medium 3TextVision131K
- Mistral: Mistral Medium 3.1TextVision131K
- Mistral: Mistral Small CreativeText33K
- Mistral: Devstral 2 2512Text262K
- Mistral: Devstral Small 1.1Text131K
- Mistral: Ministral 3 14B 2512TextVision262K
- Mistral: Ministral 3 3B 2512TextVision131K
- Mistral: Ministral 3 8B 2512TextVision262K
- Mistral: Mistral Small 3.2 24BVisionText128K
- Mistral: Mistral Small 4TextVision262K
- Mistral: Voxtral Small 24B 2507TextAudio32K
AI21 LabsNone
- AI21: Jamba Large 1.7Text256K
Alibaba (Qwen)- Qwen: Qwen Plus 0728Text1M
- Qwen: Qwen Plus 0728 (thinking)Text1M
- Qwen: Qwen3 Coder FlashText1M
- Qwen: Qwen3 Coder PlusText1M
- Qwen: Qwen3 MaxText262K
- Qwen: Qwen3 Max ThinkingText262K
- Qwen: Qwen3.5 Plus 2026-02-15TextVisionVideo1M
- Qwen: Qwen3.5-FlashTextVisionVideo1M
- Qwen: Qwen3.6 PlusTextVisionVideo1M
- Qwen: Qwen3 14BText41K
- Qwen: Qwen3 235B A22BText131K
- Qwen: Qwen3 235B A22B Instruct 2507Text262K
- Qwen: Qwen3 235B A22B Thinking 2507Text131K
- Qwen: Qwen3 30B A3BText41K
- Qwen: Qwen3 30B A3B Instruct 2507Text262K
- Qwen: Qwen3 30B A3B Thinking 2507Text131K
- Qwen: Qwen3 32BText41K
- Qwen: Qwen3 8BText41K
- Qwen: Qwen3 Coder 30B A3B InstructText160K
- Qwen: Qwen3 Coder 480B A35BText262K
- Qwen: Qwen3 Coder NextText262K
- Qwen: Qwen3 Next 80B A3B InstructText262K
- Qwen: Qwen3 Next 80B A3B ThinkingText131K
- Qwen: Qwen3 VL 235B A22B InstructTextVision262K
- Qwen: Qwen3 VL 235B A22B ThinkingTextVision131K
- Qwen: Qwen3 VL 30B A3B InstructTextVision131K
- Qwen: Qwen3 VL 30B A3B ThinkingTextVision131K
- Qwen: Qwen3 VL 32B InstructTextVision131K
- Qwen: Qwen3 VL 8B InstructVisionText131K
- Qwen: Qwen3 VL 8B ThinkingVisionText131K
- Qwen: Qwen3.5 397B A17BTextVisionVideo262K
- Qwen: Qwen3.5-122B-A10BTextVisionVideo262K
- Qwen: Qwen3.5-27BTextVisionVideo262K
- Qwen: Qwen3.5-35B-A3BTextVisionVideo262K
- Qwen: Qwen3.5-9BTextVisionVideo262K
ByteDance- Seed: Seed 1.6VisionTextVideo262K
- Seed: Seed 1.6 FlashVisionTextVideo262K
- Seed: Seed-2.0-LiteTextVisionVideo262K
- Seed: Seed-2.0-MiniTextVisionVideo262K
None
DeepSeekNone
- DeepSeek: DeepSeek V3.1Text33K
- DeepSeek: DeepSeek V3.1 TerminusText164K
- DeepSeek: DeepSeek V3.2Text131K
- DeepSeek: DeepSeek V3.2 ExpText164K
- DeepSeek: DeepSeek V3.2 SpecialeText164K
- DeepSeek: DeepSeek V4 FlashText1M
- DeepSeek: DeepSeek V4 ProText1M
- DeepSeek: R1 0528Text164K
MiniMax- MiniMax: MiniMax M1Text1M
- MiniMax: MiniMax M2-herText66K
- MiniMax: MiniMax M2Text197K
- MiniMax: MiniMax M2.1Text197K
- MiniMax: MiniMax M2.5Text197K
- MiniMax: MiniMax M2.7Text197K