The Inference Report

August 7, 2026

AI Labs — News

The lab announcements today reveal two distinct competitive postures: OpenAI is consolidating its consumer moat through product velocity and data collection, while infrastructure players are racing to embed themselves deeper into the development and education layers. OpenAI expanded GPT-5.6 Luna access to free users, improved GPT-5.6 Sol's accuracy, and published usage analytics across countries, moves that lock in usage data and normalize reliance on its models as the default reasoning engine. The American Psychological Association partnership, while framed around youth safety, also positions OpenAI as the trusted interface between AI and regulated sectors that require credentialing and institutional buy-in. Meanwhile, NVIDIA, AMD, and others are fighting for control of the infrastructure stack below the application layer. NVIDIA's open letter about "open weights and American AI leadership" signals a strategic pivot away from proprietary model races toward owning the hardware and software layers that any model runs on, a more durable competitive position. AMD is targeting diffusion model optimization and education infrastructure, recognizing that whoever controls the classroom controls the next generation of model builders. GitHub's expansion of Copilot with slash commands and Hugging Face's move to formalize Baseten as an inference provider both reflect a shift toward embedding AI into workflows rather than selling standalone applications. Google DeepMind's cyclone forecasting breakthrough and Anthropic's biology safeguards work appear designed to generate credibility in high-stakes domains, but neither announcement includes deployment details or user adoption metrics. IBM's ROI measurement tool and the various infrastructure plays suggest the market is moving past the "what if" phase into the "prove the business case" phase, which means the labs betting on usage volume and data advantage have a window before procurement teams demand evidence of actual cost reduction.

Sloane Duvall

AMD

Anthropic

Improving Fable 5's biology safeguards

GitHub Blog

A guide to slash commands in the GitHub Copilot app

Google DeepMind

WeatherNext: AI model achieves breakthrough in forecasting cyclones

Hugging Face

Baseten on Hugging Face Inference Providers 🔥

IBM

IBM Introduces Apptio AI Value & ROI to Close the Gap Between AI Spend and Business Results

NVIDIA

OpenAI

AI Labs — Models

A curated reference of models from major AI labs, with open/closed weight status, input modalities, and context window size. American labs tend towards closed weights models and Chinese labs tend toward open weights models.

AllenAI

Closed Weights

None

Open Weights

AllenAI: Olmo 3 32B Think
Text66K

Amazon

Closed Weights

Amazon: Nova 2 Lite
TextVisionVideoFiles1M
Amazon: Nova Premier 1.0
TextVision1M

Open Weights

None

Anthropic

Closed Weights

Anthropic: Claude Fable 5
TextVisionFiles1M
Anthropic: Claude Haiku 4.5
TextVisionFiles200K
Anthropic: Claude Opus 4.5
FilesVisionText200K
Anthropic: Claude Opus 4.6
TextVisionFiles1M
Anthropic: Claude Opus 4.7
TextVisionFiles1M
Anthropic: Claude Opus 4.7 (Fast)
TextVisionFiles1M
Anthropic: Claude Opus 4.8
TextVisionFiles1M
Anthropic: Claude Opus 4.8 (Fast)
TextVisionFiles1M
Anthropic: Claude Sonnet 4.5
TextVisionFiles1M
Anthropic: Claude Sonnet 4.6
TextVisionFiles1M
Anthropic: Claude Sonnet 5
TextVisionFiles1M
Claude Opus 5
TextVisionFiles1M
Claude Opus 5 (Fast)
TextVisionFiles1M

Open Weights

None

Arcee AI

Closed Weights

None

Open Weights

Arcee AI: Trinity Large Thinking
Text262K

Deep Cogito

Closed Weights

None

Open Weights

Deep Cogito: Cogito v2.1 671B
Text128K

Google

Closed Weights

Google: Gemini 3 Flash Preview
TextVisionFilesAudioVideo1M
Google: Gemini 3.1 Flash Lite
TextVisionVideoFilesAudio1M
Google: Gemini 3.1 Flash Lite Preview
TextVisionVideoFilesAudio1M
Google: Gemini 3.1 Pro Preview
AudioFilesVisionTextVideo1M
Google: Gemini 3.1 Pro Preview Custom Tools
TextAudioVisionVideoFiles1M
Google: Gemini 3.5 Flash
TextVisionVideoFilesAudio1M
Google: Gemini 3.5 Flash Lite
TextVisionVideoFilesAudio1M
Google: Gemini 3.6 Flash
TextVisionVideoFilesAudio1M
Google: Lyria 3 Clip Preview
TextVision1M
Google: Lyria 3 Pro Preview
TextVision1M
Google: Nano Banana (Gemini 2.5 Flash Image)
VisionText33K
Google: Nano Banana 2 (Gemini 3.1 Flash Image Preview)
VisionText66K
Google: Nano Banana 2 (Gemini 3.1 Flash Image)
VisionText131K
Google: Nano Banana 2 Lite (Gemini 3.1 Flash Lite Image)
VisionText66K
Google: Nano Banana Pro (Gemini 3 Pro Image Preview)
VisionText66K
Google: Nano Banana Pro (Gemini 3 Pro Image)
VisionText131K

Open Weights

Google: Gemma 4 26B A4B
VisionTextVideo262K
Google: Gemma 4 31B
VisionTextVideo262K

IBM

Closed Weights

None

Open Weights

IBM: Granite 4.0 Micro
Text131K
IBM: Granite 4.1 8B
Text131K

Inception

Closed Weights

Inception: Mercury 2
Text128K

Open Weights

None

Meta (Muse)

Closed Weights

Meta: Muse Spark 1.1
TextVisionVideoFilesAudio1M
Meta: Muse Spark 1.2
TextVisionVideoFilesAudio1M

Open Weights

None

Nous Research

Closed Weights

None

Open Weights

Nous: Hermes 4 405B
Text131K
Nous: Hermes 4 70B
Text131K

NVIDIA

Closed Weights

None

Open Weights

NVIDIA: Nemotron 3 Nano 30B A3B
Text262K
NVIDIA: Nemotron 3 Super
Text1M
NVIDIA: Nemotron 3 Ultra
Text512K

OpenAI

Closed Weights

OpenAI: GPT Audio
TextAudio128K
OpenAI: GPT Audio Mini
TextAudio128K
OpenAI: GPT-5
TextVisionFiles400K
OpenAI: GPT-5 Image
VisionTextFiles400K
OpenAI: GPT-5 Image Mini
FilesVisionText400K
OpenAI: GPT-5 Mini
TextVisionFiles400K
OpenAI: GPT-5 Nano
TextVisionFiles400K
OpenAI: GPT-5 Pro
VisionTextFiles400K
OpenAI: GPT-5.1
VisionTextFiles400K
OpenAI: GPT-5.1-Codex
TextVision400K
OpenAI: GPT-5.1-Codex-Max
TextVision400K
OpenAI: GPT-5.1-Codex-Mini
VisionText400K
OpenAI: GPT-5.2
FilesVisionText400K
OpenAI: GPT-5.2 Chat
FilesVisionText128K
OpenAI: GPT-5.2 Pro
VisionTextFiles400K
OpenAI: GPT-5.2-Codex
TextVision400K
OpenAI: GPT-5.3 Chat
TextVisionFiles128K
OpenAI: GPT-5.3-Codex
TextVisionFiles400K
OpenAI: GPT-5.4
TextVisionFiles1M
OpenAI: GPT-5.4 Image 2
VisionTextFiles272K
OpenAI: GPT-5.4 Mini
FilesVisionText400K
OpenAI: GPT-5.4 Nano
FilesVisionText400K
OpenAI: GPT-5.4 Pro
TextVisionFiles1M
OpenAI: GPT-5.5
FilesVisionText1M
OpenAI: GPT-5.5 Pro
FilesVisionText1M
OpenAI: GPT-5.6 Luna
FilesVisionText1M
OpenAI: GPT-5.6 Luna Pro
FilesVisionText1M
OpenAI: GPT-5.6 Sol
FilesVisionText1M
OpenAI: GPT-5.6 Sol Pro
FilesVisionText1M
OpenAI: GPT-5.6 Terra
FilesVisionText1M
OpenAI: GPT-5.6 Terra Pro
FilesVisionText1M

Open Weights

None

Perceptron

Closed Weights

Perceptron: Perceptron Mk1
TextVisionVideo33K

Open Weights

None

Perplexity

Closed Weights

Perplexity: Sonar Pro Search
TextVision200K

Open Weights

None

Poolside

Closed Weights

None

Open Weights

Poolside: Laguna S 2.1
Text1M
Poolside: Laguna XS 2.1
Text262K

Reka AI

Closed Weights

None

Open Weights

Reka Edge
VisionTextVideo16K

Relace

Closed Weights

None

Open Weights

Relace: Relace Apply 3
Text256K
Relace: Relace Search
Text256K

Thinking Machines

Closed Weights

None

Open Weights

Thinking Machines: Inkling
TextVisionAudio1M
Thinking Machines: Inkling Small
TextVisionAudio524K

xAI

Closed Weights

SpaceXAI: Grok 4.20
TextVisionFiles2M
SpaceXAI: Grok 4.20 Multi-Agent
TextVisionFiles2M
SpaceXAI: Grok 4.3
TextVisionFiles1M
SpaceXAI: Grok 4.5
TextVisionFiles500K
SpaceXAI: Grok Build 0.1
TextVisionFiles256K

Open Weights

None

Mistral AI

Closed Weights

Mistral: Mistral Medium 3.1
TextVisionFiles131K

Open Weights

Mistral: Ministral 3 14B 2512
TextVision262K
Mistral: Ministral 3 3B 2512
TextVision131K
Mistral: Ministral 3 8B 2512
TextVision262K
Mistral: Mistral Large 3 2512
TextVisionFiles262K
Mistral: Mistral Medium 3.5
TextVisionFiles262K
Mistral: Mistral Small 4
TextVision262K
Mistral: Voxtral Small 24B 2507
TextAudioFiles32K

AI21 Labs

Closed Weights

None

Open Weights

AI21: Jamba Large 1.7
Text256K

Alibaba (Qwen)

Closed Weights

Qwen: Qwen3 Coder Flash
Text1M
Qwen: Qwen3 Coder Plus
Text1M
Qwen: Qwen3 Max
Text262K
Qwen: Qwen3 Max Thinking
Text262K
Qwen: Qwen3.6 Flash
TextVisionVideo1M
Qwen: Qwen3.6 Max Preview
Text262K
Qwen: Qwen3.6 Plus
TextVisionVideo1M
Qwen: Qwen3.7 Flash
TextVisionVideo1M
Qwen: Qwen3.7 Max
Text1M
Qwen: Qwen3.7 Plus
TextVision1M

Open Weights

Qwen: Qwen3 30B A3B Thinking 2507
Text82K
Qwen: Qwen3 Coder Next
Text262K
Qwen: Qwen3 Next 80B A3B Instruct
Text262K
Qwen: Qwen3 Next 80B A3B Thinking
Text262K
Qwen: Qwen3 VL 235B A22B Instruct
TextVision262K
Qwen: Qwen3 VL 235B A22B Thinking
TextVision131K
Qwen: Qwen3 VL 30B A3B Instruct
TextVision262K
Qwen: Qwen3 VL 30B A3B Thinking
TextVision262K
Qwen: Qwen3 VL 32B Instruct
TextVision131K
Qwen: Qwen3 VL 8B Instruct
VisionText262K
Qwen: Qwen3 VL 8B Thinking
VisionText131K
Qwen: Qwen3.5 397B A17B
TextVisionVideo262K
Qwen: Qwen3.5-122B-A10B
TextVisionVideo262K
Qwen: Qwen3.5-27B
TextVisionVideo262K
Qwen: Qwen3.5-35B-A3B
TextVisionVideo262K
Qwen: Qwen3.5-9B
TextVisionVideo262K
Qwen: Qwen3.6 27B
TextVisionVideo262K
Qwen: Qwen3.6 35B A3B
TextVisionVideo262K
Qwen: Qwen3.8 Max
TextVisionVideo1M

ByteDance

Closed Weights

Seed: Seed 1.6
VisionTextVideo262K
Seed: Seed 1.6 Flash
VisionTextVideo262K
Seed: Seed-2.0-Lite
TextVisionVideo262K
Seed: Seed-2.0-Mini
TextVisionVideo262K

Open Weights

None

DeepSeek

Closed Weights

None

Open Weights

DeepSeek: DeepSeek V3.1
Text164K
DeepSeek: DeepSeek V3.1 Terminus
Text164K
DeepSeek: DeepSeek V3.2
Text164K
DeepSeek: DeepSeek V3.2 Exp
Text164K
DeepSeek: DeepSeek V4 Flash 0423
Text1M
DeepSeek: DeepSeek V4 Flash 0731
Text1M
DeepSeek: DeepSeek V4 Pro
Text1M

MiniMax

Closed Weights

MiniMax: MiniMax M2-her
Text66K

Open Weights

MiniMax: MiniMax M2
Text205K
MiniMax: MiniMax M2.1
Text205K
MiniMax: MiniMax M2.5
Text205K
MiniMax: MiniMax M2.7
Text205K
MiniMax: MiniMax M3
TextVisionVideo1M

Moonshot AI

Closed Weights

None

Open Weights

MoonshotAI: Kimi K2 0905
Text262K
MoonshotAI: Kimi K2 Thinking
Text262K
MoonshotAI: Kimi K2.5
TextVision262K
MoonshotAI: Kimi K2.6
TextVision262K
MoonshotAI: Kimi K2.7 Code
TextVision262K
MoonshotAI: Kimi K3
TextVision1M

Xiaomi

Closed Weights

None

Open Weights

Xiaomi: MiMo-V2.5
TextAudioVisionVideo1M
Xiaomi: MiMo-V2.5-Pro
Text1M

Z.ai

Closed Weights

None

Open Weights

Z.ai: GLM 4.5V
TextVision66K
Z.ai: GLM 4.6
Text205K
Z.ai: GLM 4.6V
VisionTextVideo131K
Z.ai: GLM 4.7
Text205K
Z.ai: GLM 4.7 Flash
Text203K
Z.ai: GLM 5
Text205K
Z.ai: GLM 5 Turbo
Text203K
Z.ai: GLM 5.1
Text205K
Z.ai: GLM 5.2
Text1M
Z.ai: GLM 5V Turbo
VisionTextVideo203K

Upstage

Closed Weights

Upstage: Solar Pro 3
Text131K

Open Weights

None