The Inference Report
August 4, 2026
AI Labs — News
OpenAI is simultaneously playing offense and defense across three distinct fronts. The Apple statement is pure litigation theater, a public rebuttal designed to shape narrative before discovery proceeds, signaling that OpenAI will fight intellectual property and trade secret claims in the court of opinion as well as law. Meanwhile, GPT-Live represents the company's push into infrastructure that locks in latency advantages; a six-month build cycle on realtime voice suggests either a significant engineering effort or a claim designed to emphasize speed-to-market over competitors still working through the same problem. The Circles case study is the real tell. A 22% ARPU lift and 9% churn reduction in telecom, a sector obsessed with measurable unit economics, demonstrates that API monetization is working beyond the consumer-facing narrative. OpenAI is building a playbook where enterprise customers can point to concrete financial returns, which matters more than any benchmark score when CFOs decide whether to commit budget. The three announcements together sketch a company managing legal risk, securing technical moats in realtime interaction, and quietly proving that the API business generates the kind of defensible unit economics that justify the valuation.
Sloane Duvall
AI Labs — Models
A curated reference of models from major AI labs, with open/closed weight status, input modalities, and context window size. American labs tend towards closed weights models and Chinese labs tend toward open weights models.
AllenAIClosed Weights
None
Open Weights
- AllenAI: Olmo 3 32B ThinkText66K
AmazonClosed Weights
- Amazon: Nova 2 LiteTextVisionVideoFiles1M
- Amazon: Nova Premier 1.0TextVision1M
Open Weights
None
AnthropicClosed Weights
- Anthropic: Claude Fable 5TextVisionFiles1M
- Anthropic: Claude Haiku 4.5TextVisionFiles200K
- Anthropic: Claude Opus 4.1VisionTextFiles200K
- Anthropic: Claude Opus 4.5FilesVisionText200K
- Anthropic: Claude Opus 4.6TextVisionFiles1M
- Anthropic: Claude Opus 4.7TextVisionFiles1M
- Anthropic: Claude Opus 4.7 (Fast)TextVisionFiles1M
- Anthropic: Claude Opus 4.8TextVisionFiles1M
- Anthropic: Claude Opus 4.8 (Fast)TextVisionFiles1M
- Anthropic: Claude Sonnet 4.5TextVisionFiles1M
- Anthropic: Claude Sonnet 4.6TextVisionFiles1M
- Anthropic: Claude Sonnet 5TextVisionFiles1M
- Claude Opus 5TextVisionFiles1M
- Claude Opus 5 (Fast)TextVisionFiles1M
Open Weights
None
Arcee AIClosed Weights
None
Open Weights
- Arcee AI: Trinity Large ThinkingText262K
Deep CogitoClosed Weights
None
Open Weights
- Deep Cogito: Cogito v2.1 671BText128K
GoogleClosed Weights
- Google: Gemini 3 Flash PreviewTextVisionFilesAudioVideo1M
- Google: Gemini 3.1 Flash LiteTextVisionVideoFilesAudio1M
- Google: Gemini 3.1 Flash Lite PreviewTextVisionVideoFilesAudio1M
- Google: Gemini 3.1 Pro PreviewAudioFilesVisionTextVideo1M
- Google: Gemini 3.1 Pro Preview Custom ToolsTextAudioVisionVideoFiles1M
- Google: Gemini 3.5 FlashTextVisionVideoFilesAudio1M
- Google: Gemini 3.5 Flash LiteTextVisionVideoFilesAudio1M
- Google: Gemini 3.6 FlashTextVisionVideoFilesAudio1M
- Google: Lyria 3 Clip PreviewTextVision1M
- Google: Lyria 3 Pro PreviewTextVision1M
- Google: Nano Banana (Gemini 2.5 Flash Image)VisionText33K
- Google: Nano Banana 2 (Gemini 3.1 Flash Image Preview)VisionText66K
- Google: Nano Banana 2 (Gemini 3.1 Flash Image)VisionText131K
- Google: Nano Banana 2 Lite (Gemini 3.1 Flash Lite Image)VisionText66K
- Google: Nano Banana Pro (Gemini 3 Pro Image Preview)VisionText66K
- Google: Nano Banana Pro (Gemini 3 Pro Image)VisionText131K
Open Weights
- Google: Gemma 4 26B A4B VisionTextVideo262K
- Google: Gemma 4 31BVisionTextVideo262K
IBMClosed Weights
None
Open Weights
- IBM: Granite 4.0 MicroText131K
- IBM: Granite 4.1 8BText131K
InceptionClosed Weights
- Inception: Mercury 2Text128K
Open Weights
None
Meta (Muse)Closed Weights
- Meta: Muse Spark 1.1TextVisionVideoFilesAudio1M
Open Weights
None
Nous ResearchClosed Weights
None
Open Weights
- Nous: Hermes 4 405BText131K
- Nous: Hermes 4 70BText131K
NVIDIAClosed Weights
None
Open Weights
- NVIDIA: Nemotron 3 Nano 30B A3BText262K
- NVIDIA: Nemotron 3 SuperText1M
- NVIDIA: Nemotron 3 UltraText512K
OpenAIClosed Weights
- OpenAI: GPT AudioTextAudio128K
- OpenAI: GPT Audio MiniTextAudio128K
- OpenAI: GPT-5TextVisionFiles400K
- OpenAI: GPT-5 ImageVisionTextFiles400K
- OpenAI: GPT-5 Image MiniFilesVisionText400K
- OpenAI: GPT-5 MiniTextVisionFiles400K
- OpenAI: GPT-5 NanoTextVisionFiles400K
- OpenAI: GPT-5 ProVisionTextFiles400K
- OpenAI: GPT-5.1VisionTextFiles400K
- OpenAI: GPT-5.1-CodexTextVision400K
- OpenAI: GPT-5.1-Codex-MaxTextVision400K
- OpenAI: GPT-5.1-Codex-MiniVisionText400K
- OpenAI: GPT-5.2FilesVisionText400K
- OpenAI: GPT-5.2 ChatFilesVisionText128K
- OpenAI: GPT-5.2 ProVisionTextFiles400K
- OpenAI: GPT-5.2-CodexTextVision400K
- OpenAI: GPT-5.3 ChatTextVisionFiles128K
- OpenAI: GPT-5.3-CodexTextVisionFiles400K
- OpenAI: GPT-5.4TextVisionFiles1M
- OpenAI: GPT-5.4 Image 2VisionTextFiles272K
- OpenAI: GPT-5.4 MiniFilesVisionText400K
- OpenAI: GPT-5.4 NanoFilesVisionText400K
- OpenAI: GPT-5.4 ProTextVisionFiles1M
- OpenAI: GPT-5.5FilesVisionText1M
- OpenAI: GPT-5.5 ProFilesVisionText1M
- OpenAI: GPT-5.6 LunaFilesVisionText1M
- OpenAI: GPT-5.6 Luna ProFilesVisionText1M
- OpenAI: GPT-5.6 SolFilesVisionText1M
- OpenAI: GPT-5.6 Sol ProFilesVisionText1M
- OpenAI: GPT-5.6 TerraFilesVisionText1M
- OpenAI: GPT-5.6 Terra ProFilesVisionText1M
Open Weights
- OpenAI: gpt-oss-120bText131K
- OpenAI: gpt-oss-20bText131K
PerceptronClosed Weights
- Perceptron: Perceptron Mk1TextVisionVideo33K
Open Weights
None
PerplexityClosed Weights
- Perplexity: Sonar Pro SearchTextVision200K
Open Weights
None
PoolsideClosed Weights
None
Open Weights
- Poolside: Laguna S 2.1Text1M
- Poolside: Laguna XS 2.1Text262K
Reka AIClosed Weights
None
Open Weights
- Reka EdgeVisionTextVideo16K
RelaceClosed Weights
None
Open Weights
- Relace: Relace Apply 3Text256K
- Relace: Relace SearchText256K
Thinking MachinesClosed Weights
None
Open Weights
- Thinking Machines: InklingTextVisionAudio1M
- Thinking Machines: Inkling SmallTextVisionAudio524K
xAIClosed Weights
- xAI: Grok 4.20TextVisionFiles2M
- xAI: Grok 4.20 Multi-AgentTextVisionFiles2M
- xAI: Grok 4.3TextVisionFiles1M
- xAI: Grok 4.5TextVisionFiles500K
- xAI: Grok Build 0.1TextVisionFiles256K
Open Weights
None
Mistral AIClosed Weights
- Mistral: Mistral Medium 3.1TextVisionFiles131K
Open Weights
- Mistral: Ministral 3 14B 2512TextVision262K
- Mistral: Ministral 3 3B 2512TextVision131K
- Mistral: Ministral 3 8B 2512TextVision262K
- Mistral: Mistral Large 3 2512TextVisionFiles262K
- Mistral: Mistral Medium 3.5TextVisionFiles262K
- Mistral: Mistral Small 4TextVision262K
- Mistral: Voxtral Small 24B 2507TextAudioFiles32K
AI21 LabsClosed Weights
None
Open Weights
- AI21: Jamba Large 1.7Text256K
Alibaba (Qwen)Closed Weights
- Qwen: Qwen3 Coder FlashText1M
- Qwen: Qwen3 Coder PlusText1M
- Qwen: Qwen3 MaxText262K
- Qwen: Qwen3 Max ThinkingText262K
- Qwen: Qwen3.6 FlashTextVisionVideo1M
- Qwen: Qwen3.6 Max PreviewText262K
- Qwen: Qwen3.6 PlusTextVisionVideo1M
- Qwen: Qwen3.7 FlashTextVisionVideo1M
- Qwen: Qwen3.7 MaxText1M
- Qwen: Qwen3.7 PlusTextVision1M
Open Weights
- Qwen: Qwen3 30B A3B Thinking 2507Text82K
- Qwen: Qwen3 Coder NextText262K
- Qwen: Qwen3 Next 80B A3B InstructText262K
- Qwen: Qwen3 Next 80B A3B ThinkingText262K
- Qwen: Qwen3 VL 235B A22B InstructTextVision262K
- Qwen: Qwen3 VL 235B A22B ThinkingTextVision131K
- Qwen: Qwen3 VL 30B A3B InstructTextVision262K
- Qwen: Qwen3 VL 30B A3B ThinkingTextVision262K
- Qwen: Qwen3 VL 32B InstructTextVision131K
- Qwen: Qwen3 VL 8B InstructVisionText262K
- Qwen: Qwen3 VL 8B ThinkingVisionText131K
- Qwen: Qwen3.5 397B A17BTextVisionVideo262K
- Qwen: Qwen3.5-122B-A10BTextVisionVideo262K
- Qwen: Qwen3.5-27BTextVisionVideo262K
- Qwen: Qwen3.5-35B-A3BTextVisionVideo262K
- Qwen: Qwen3.5-9BTextVisionVideo262K
- Qwen: Qwen3.6 27BTextVisionVideo262K
- Qwen: Qwen3.6 35B A3BTextVisionVideo262K
- Qwen: Qwen3.8 MaxTextVisionVideo1M
ByteDanceClosed Weights
- Seed: Seed 1.6VisionTextVideo262K
- Seed: Seed 1.6 FlashVisionTextVideo262K
- Seed: Seed-2.0-LiteTextVisionVideo262K
- Seed: Seed-2.0-MiniTextVisionVideo262K
Open Weights
None
DeepSeekClosed Weights
None
Open Weights
- DeepSeek: DeepSeek V3.1Text164K
- DeepSeek: DeepSeek V3.1 TerminusText164K
- DeepSeek: DeepSeek V3.2Text164K
- DeepSeek: DeepSeek V3.2 ExpText164K
- DeepSeek: DeepSeek V4 Flash 0423Text1M
- DeepSeek: DeepSeek V4 Flash 0731Text1M
- DeepSeek: DeepSeek V4 ProText1M
MiniMaxClosed Weights
- MiniMax: MiniMax M2-herText66K
Open Weights
- MiniMax: MiniMax M2Text205K
- MiniMax: MiniMax M2.1Text205K
- MiniMax: MiniMax M2.5Text205K
- MiniMax: MiniMax M2.7Text205K
- MiniMax: MiniMax M3TextVisionVideo1M
Moonshot AIClosed Weights
None
Open Weights
- MoonshotAI: Kimi K2 0905Text262K
- MoonshotAI: Kimi K2 ThinkingText262K
- MoonshotAI: Kimi K2.5TextVision262K
- MoonshotAI: Kimi K2.6TextVision262K
- MoonshotAI: Kimi K2.7 CodeTextVision262K
- MoonshotAI: Kimi K3TextVision1M
XiaomiClosed Weights
None
Open Weights
- Xiaomi: MiMo-V2.5TextAudioVisionVideo1M
- Xiaomi: MiMo-V2.5-ProText1M
Z.aiClosed Weights
None
Open Weights
- Z.ai: GLM 4.5VTextVision66K
- Z.ai: GLM 4.6Text205K
- Z.ai: GLM 4.6VVisionTextVideo131K
- Z.ai: GLM 4.7Text205K
- Z.ai: GLM 4.7 FlashText203K
- Z.ai: GLM 5Text205K
- Z.ai: GLM 5 TurboText203K
- Z.ai: GLM 5.1Text205K
- Z.ai: GLM 5.2Text1M
- Z.ai: GLM 5V TurboVisionTextVideo203K
UpstageClosed Weights
- Upstage: Solar Pro 3Text128K
Open Weights
None