The Inference Report

October 9, 2026
AI Labs — News

The announcements today reveal three distinct competitive postures: a race to embed AI into enterprise workflows at scale, a scramble for infrastructure dominance as training and inference costs become the primary battleground, and a pivot toward public-facing safety and research positioning that mirrors regulatory and reputational concerns. OpenAI is showcasing cost efficiency and workflow automation across Oracle, LegalOn, and creative tools, the message is that their models are already cutting real spending and accelerating work, which matters more than abstract capability claims. Meanwhile, NVIDIA and AMD are locked in a technical specification war over which accelerators train and serve models faster and cheaper, with AMD publishing detailed performance breakdowns and NVIDIA committing $1 billion to position itself as the infrastructure partner for "super intelligence research," a framing that sidesteps the commodity chip competition by attaching hardware to national interest. Anthropic, by contrast, is broadcasting commitment to American science, cyber defense, and open-source vulnerability scanning, positioning itself as the trustworthy alternative rather than the efficiency leader. The collective signal is that the market has bifurcated: one track rewards builders who ship products that reduce customer costs, another rewards infrastructure vendors who can prove performance per dollar, and a third rewards labs that can credibly claim alignment with public goods and national priorities. The labs are not competing on the same axis anymore.

Sloane Duvall

AMD
Anthropic
Hugging Face
NVIDIA
OpenAI
AI Labs — Models

A curated reference of models from major AI labs, with open/closed weight status, input modalities, and context window size. American labs tend towards closed weights models and Chinese labs tend toward open weights models.

usAllenAI
Closed Weights

None

Open Weights
  • AllenAI: Olmo 3 32B Think
    Text66K
usAmazon
Closed Weights
  • Amazon: Nova 2 Lite
    TextVisionVideoFiles1M
  • Amazon: Nova Premier 1.0
    TextVision1M
Open Weights

None

usAnthropic
Closed Weights
  • Anthropic: Claude Fable 5
    TextVisionFiles1M
  • Anthropic: Claude Fable 5.1
    TextVisionFiles1M
  • Anthropic: Claude Haiku 4.5
    TextVisionFiles200K
  • Anthropic: Claude Haiku 5.5
    TextVisionFiles1M
  • Anthropic: Claude Opus 4.5
    FilesVisionText200K
  • Anthropic: Claude Opus 4.6
    TextVisionFiles1M
  • Anthropic: Claude Opus 4.7
    TextVisionFiles1M
  • Anthropic: Claude Opus 4.8
    TextVisionFiles1M
  • Anthropic: Claude Opus 5
    TextVisionFiles1M
  • Anthropic: Claude Opus 5.5
    TextVisionFiles1M
  • Anthropic: Claude Sonnet 4.6
    TextVisionFiles1M
  • Anthropic: Claude Sonnet 5
    TextVisionFiles1M
  • Anthropic: Claude Sonnet 5.5
    TextVisionFiles1M
Open Weights

None

usArcee AI
Closed Weights

None

Open Weights
  • Arcee AI: Trinity Large Thinking
    Text262K
usDeep Cogito
Closed Weights

None

Open Weights
  • Deep Cogito: Cogito v2.1 671B
    Text128K
usGoogle
Closed Weights
  • Google: Gemini 3 Flash Preview
    TextVisionFilesAudioVideo1M
  • Google: Gemini 3.1 Flash Lite
    TextVisionVideoFilesAudio1M
  • Google: Gemini 3.1 Flash Lite Preview
    TextVisionVideoFilesAudio1M
  • Google: Gemini 3.1 Pro Preview
    AudioFilesVisionTextVideo1M
  • Google: Gemini 3.1 Pro Preview Custom Tools
    TextAudioVisionVideoFiles1M
  • Google: Gemini 3.5 Flash
    TextVisionVideoFilesAudio1M
  • Google: Gemini 3.5 Flash Lite
    TextVisionVideoFilesAudio1M
  • Google: Gemini 3.6 Flash
    TextVisionVideoFilesAudio1M
  • Google: Gemini 3.7 Flash
    TextVisionVideoFilesAudio1M
  • Google: Gemini 3.8 Flash
    TextVisionVideoFilesAudio1M
  • Google: Lyria 3 Clip Preview
    TextVision1M
  • Google: Lyria 3 Pro Preview
    TextVision1M
  • Google: Nano Banana 2 (Gemini 3.1 Flash Image Preview)
    VisionText66K
  • Google: Nano Banana 2 (Gemini 3.1 Flash Image)
    VisionText131K
  • Google: Nano Banana 2 Lite (Gemini 3.1 Flash Lite Image)
    VisionText66K
  • Google: Nano Banana 2.1
    VisionText66K
  • Google: Nano Banana Pro (Gemini 3 Pro Image Preview)
    VisionText66K
  • Google: Nano Banana Pro (Gemini 3 Pro Image)
    VisionText131K
Open Weights
  • Google: Gemma 4 26B A4B
    VisionTextVideo262K
  • Google: Gemma 4 31B
    VisionTextVideo262K
usIBM
Closed Weights

None

Open Weights
  • IBM: Granite 4.0 Micro
    Text131K
  • IBM: Granite 4.2 8B
    Text131K
usInception
Closed Weights
  • Inception: Mercury 2
    Text128K
  • Inception: Mercury 2.5
    Text260K
Open Weights

None

usMeta (Muse)
Closed Weights
  • Meta: Muse Spark 1.1
    TextVisionVideoFiles1M
  • Meta: Muse Spark 1.2
    TextVisionVideoFiles1M
  • Meta: Muse Spark 1.2 Contributor
    TextVisionVideoFiles1M
  • Meta: Muse Spark 1.3
    TextVisionVideoFiles1M
  • Meta: Muse Spark 1.3 Contributor
    TextVisionVideoFiles1M
Open Weights
  • Meta: Muse Glimmer 30B
    TextVision131K
usNVIDIA
Closed Weights

None

Open Weights
  • NVIDIA: Nemotron 3 Nano 30B A3B
    Text262K
  • NVIDIA: Nemotron 3 Super
    Text262K
  • NVIDIA: Nemotron 3 Ultra
    Text262K
  • NVIDIA: Nemotron 3.5 Lightning
    Text262K
  • NVIDIA: Switchyard
    Text1M
usOpenAI
Closed Weights
  • OpenAI: GPT Audio
    TextAudio128K
  • OpenAI: GPT Audio Mini
    TextAudio128K
  • OpenAI: GPT-5 Image
    VisionTextFiles400K
  • OpenAI: GPT-5 Image Mini
    FilesVisionText400K
  • OpenAI: GPT-5.1
    VisionTextFiles400K
  • OpenAI: GPT-5.1-Codex
    TextVision400K
  • OpenAI: GPT-5.1-Codex-Max
    TextVision400K
  • OpenAI: GPT-5.1-Codex-Mini
    VisionText400K
  • OpenAI: GPT-5.2
    FilesVisionText400K
  • OpenAI: GPT-5.2 Chat
    FilesVisionText128K
  • OpenAI: GPT-5.2 Pro
    VisionTextFiles400K
  • OpenAI: GPT-5.2-Codex
    TextVision400K
  • OpenAI: GPT-5.3-Codex
    TextVisionFiles400K
  • OpenAI: GPT-5.4
    TextVisionFiles1M
  • OpenAI: GPT-5.4 Image 2
    VisionTextFiles272K
  • OpenAI: GPT-5.4 Mini
    FilesVisionText400K
  • OpenAI: GPT-5.4 Nano
    FilesVisionText400K
  • OpenAI: GPT-5.4 Pro
    TextVisionFiles1M
  • OpenAI: GPT-5.5
    FilesVisionText1M
  • OpenAI: GPT-5.5 Pro
    FilesVisionText1M
  • OpenAI: GPT-5.6 Luna
    FilesVisionText1M
  • OpenAI: GPT-5.6 Luna Pro
    FilesVisionText1M
  • OpenAI: GPT-5.6 Sol
    FilesVisionText1M
  • OpenAI: GPT-5.6 Sol Pro
    FilesVisionText1M
  • OpenAI: GPT-5.6 Terra
    FilesVisionText1M
  • OpenAI: GPT-5.6 Terra Pro
    FilesVisionText1M
  • OpenAI: GPT-6 Astra
    FilesVisionText1M
  • OpenAI: GPT-6 Astra Pro
    FilesVisionText1M
  • OpenAI: GPT-6 Luna
    FilesVisionText1M
  • OpenAI: GPT-6 Luna Pro
    FilesVisionText1M
  • OpenAI: GPT-6 Sol
    FilesVisionText1M
  • OpenAI: GPT-6 Sol Pro
    FilesVisionText1M
  • OpenAI: GPT-6.1 Sol
    FilesVisionText1M
  • OpenAI: GPT-6.1 Sol Pro
    FilesVisionText1M
Open Weights

None

usPerceptron
Closed Weights
  • Perceptron: Perceptron Mk1
    TextVisionVideo33K
  • Perceptron: Perceptron Mk1.5
    TextVisionVideoAudio37K
Open Weights

None

usPerplexity
Closed Weights
  • Perplexity: Sonar Pro Search
    TextVision200K
Open Weights

None

usPoolside
Closed Weights

None

Open Weights
  • Poolside: Laguna S 2.1
    Text1M
  • Poolside: Laguna XS 2.1
    Text262K
usReka AI
Closed Weights

None

Open Weights
  • Reka Edge
    VisionTextVideo16K
usRelace
Closed Weights

None

Open Weights
  • Relace: Relace Search
    Text256K
usThinking Machines
Closed Weights

None

Open Weights
  • Thinking Machines: Inkling
    TextVisionAudio524K
  • Thinking Machines: Inkling Small
    TextVisionAudio524K
usxAI
Closed Weights
  • SpaceXAI: Grok 4.20
    TextVisionFiles2M
  • SpaceXAI: Grok 4.20 Multi-Agent
    TextVisionFiles2M
  • SpaceXAI: Grok 4.3
    TextVisionFiles1M
  • SpaceXAI: Grok 4.5
    TextVisionFiles500K
  • SpaceXAI: Grok 4.6
    TextVisionFiles500K
  • SpaceXAI: Grok 4.7
    TextVisionFiles500K
  • SpaceXAI: Grok Build 0.1
    TextVisionFiles256K
Open Weights

None

caCohere
Closed Weights
  • Cohere: Command A+
    TextVision192K
Open Weights

None

frMistral AI
Closed Weights

None

Open Weights
  • Mistral: Devstral 2 2512
    TextFiles262K
  • Mistral: Ministral 3 14B 2512
    TextVision262K
  • Mistral: Ministral 3 3B 2512
    TextVision131K
  • Mistral: Ministral 3 8B 2512
    TextVision262K
  • Mistral: Mistral Large 3 2512
    TextVisionFiles262K
  • Mistral: Mistral Large 4
    TextVision1M
  • Mistral: Mistral Medium 3.5
    TextVisionFiles262K
  • Mistral: Mistral Small 4
    TextVision262K
  • Mistral: Voxtral Small 24B 2507
    TextAudioFiles33K
cnAlibaba (Qwen)
Closed Weights
  • Qwen: Qwen3 Max Thinking
    Text262K
  • Qwen: Qwen3.6 Flash
    TextVisionVideo1M
  • Qwen: Qwen3.6 Max Preview
    Text262K
  • Qwen: Qwen3.6 Plus
    TextVisionVideo1M
  • Qwen: Qwen3.7 Flash
    TextVisionVideo1M
  • Qwen: Qwen3.7 Max
    Text1M
  • Qwen: Qwen3.7 Plus
    TextVision1M
Open Weights
  • Qwen: Qwen3 Coder Next
    Text262K
  • Qwen: Qwen3 VL 32B Instruct
    TextVision131K
  • Qwen: Qwen3 VL 8B Instruct
    VisionText262K
  • Qwen: Qwen3 VL 8B Thinking
    VisionText131K
  • Qwen: Qwen3.5 397B A17B
    TextVisionVideo262K
  • Qwen: Qwen3.5-122B-A10B
    TextVisionVideo262K
  • Qwen: Qwen3.5-27B
    TextVisionVideo262K
  • Qwen: Qwen3.5-35B-A3B
    TextVisionVideo262K
  • Qwen: Qwen3.5-9B
    TextVisionVideo262K
  • Qwen: Qwen3.6 27B
    TextVisionVideo262K
  • Qwen: Qwen3.6 35B A3B
    TextVisionVideo262K
  • Qwen: Qwen3.8 2.4T A95B
    Text1M
  • Qwen: Qwen3.8 27B
    TextVisionVideo1M
  • Qwen: Qwen3.8 Flash
    TextVisionVideo1M
  • Qwen: Qwen3.8 Max (0902)
    TextVisionVideo1M
  • Qwen: Qwen3.8 Max Prime
    TextVisionVideo1M
  • Qwen: Qwen3.8 Omni Flash
    TextVisionAudioVideo1M
cnByteDance
Closed Weights
  • Seed: Seed 1.6
    VisionTextVideo262K
  • Seed: Seed 1.6 Flash
    VisionTextVideo262K
  • Seed: Seed 2.1 Turbo
    TextVisionVideo262K
  • Seed: Seed-2.0-Code
    TextVisionVideo262K
  • Seed: Seed-2.0-Lite
    TextVisionVideo262K
  • Seed: Seed-2.0-Mini
    TextVisionVideo262K
Open Weights

None

cnDeepSeek
Closed Weights

None

Open Weights
  • DeepSeek: DeepSeek V3.2
    Text164K
  • DeepSeek: DeepSeek V4 Flash 0423
    Text1M
  • DeepSeek: DeepSeek V4 Flash 0731
    Text1M
  • DeepSeek: DeepSeek V4 Flash Vision Exp
    TextVision1M
  • DeepSeek: DeepSeek V4 Pro 0423
    Text1M
  • DeepSeek: DeepSeek V4 Pro 0813
    Text1M
  • DeepSeek: DeepSeek V4.1 Flash
    TextVision1M
cnMiniMax
Closed Weights
  • MiniMax: MiniMax M2-her
    Text66K
Open Weights
  • MiniMax: MiniMax M2
    Text205K
  • MiniMax: MiniMax M2.1
    Text205K
  • MiniMax: MiniMax M2.5
    Text205K
  • MiniMax: MiniMax M2.7
    Text205K
  • MiniMax: MiniMax M3
    TextVisionVideo1M
cnMoonshot AI
Closed Weights

None

Open Weights
  • MoonshotAI: Kimi K2 Thinking
    Text262K
  • MoonshotAI: Kimi K2.5
    TextVision262K
  • MoonshotAI: Kimi K2.6
    TextVision262K
  • MoonshotAI: Kimi K2.7 Code
    TextVision262K
  • MoonshotAI: Kimi K3
    TextVisionVideo1M
cnXiaomi
Closed Weights

None

Open Weights
  • Xiaomi: MiMo-V2.5
    TextAudioVisionVideo1M
  • Xiaomi: MiMo-V2.5-Pro
    Text1M
  • Xiaomi: MiMo-V2.6-Flash
    TextVisionVideoAudio1M
  • Xiaomi: MiMo-V2.6-Pro
    TextVisionVideoAudio1M
  • Xiaomi: MiMo-V2.6-Pro-UltraSpeed
    TextVisionVideoAudio1M
cnZ.ai
Closed Weights

None

Open Weights
  • Z.ai: GLM 4.6V
    VisionTextVideo131K
  • Z.ai: GLM 4.7
    Text205K
  • Z.ai: GLM 4.7 Flash
    Text200K
  • Z.ai: GLM 5
    Text205K
  • Z.ai: GLM 5 Turbo
    Text203K
  • Z.ai: GLM 5.1
    Text205K
  • Z.ai: GLM 5.2
    Text1M
  • Z.ai: GLM 5.3
    Text1M
  • Z.ai: GLM 5.3 Flash
    TextVisionVideo1M
  • Z.ai: GLM 5.3 FlashX
    TextVisionVideo1M
  • Z.ai: GLM 5.3 Prime
    Text1M
  • Z.ai: GLM 5V Turbo
    VisionTextVideo203K
krUpstage
Closed Weights
  • Upstage: Solar Mini 4
    Text524K
  • Upstage: Solar Pro 3
    Text131K
  • Upstage: Solar Pro 4
    Text524K
Open Weights

None