The Inference Report

August 6, 2026
AI Labs — News

AWS is consolidating infrastructure for AI workloads by embedding vector search directly into DynamoDB and cutting prices on foundational models through Bedrock. The vector database capability removes a separate architectural layer, companies no longer need to maintain a distinct vector store alongside their transactional database, which simplifies operations and reduces cost surface. Simultaneously, price reductions on GPT models in Bedrock lower the economic barrier to using third-party models at scale. Together, these moves position AWS to capture both the infrastructure layer and the model consumption layer for organizations building retrieval-augmented generation and semantic search applications. The strategy is defensive: make it cheaper and simpler to build AI applications on AWS than to cobble together alternatives elsewhere.

Sloane Duvall

AWS
AI Labs — Models

A curated reference of models from major AI labs, with open/closed weight status, input modalities, and context window size. American labs tend towards closed weights models and Chinese labs tend toward open weights models.

usAllenAI
Closed Weights

None

Open Weights
  • AllenAI: Olmo 3 32B Think
    Text66K
usAmazon
Closed Weights
  • Amazon: Nova 2 Lite
    TextVisionVideoFiles1M
  • Amazon: Nova Premier 1.0
    TextVision1M
Open Weights

None

usAnthropic
Closed Weights
  • Anthropic: Claude Fable 5
    TextVisionFiles1M
  • Anthropic: Claude Haiku 4.5
    TextVisionFiles200K
  • Anthropic: Claude Opus 4.5
    FilesVisionText200K
  • Anthropic: Claude Opus 4.6
    TextVisionFiles1M
  • Anthropic: Claude Opus 4.7
    TextVisionFiles1M
  • Anthropic: Claude Opus 4.7 (Fast)
    TextVisionFiles1M
  • Anthropic: Claude Opus 4.8
    TextVisionFiles1M
  • Anthropic: Claude Opus 4.8 (Fast)
    TextVisionFiles1M
  • Anthropic: Claude Sonnet 4.5
    TextVisionFiles1M
  • Anthropic: Claude Sonnet 4.6
    TextVisionFiles1M
  • Anthropic: Claude Sonnet 5
    TextVisionFiles1M
  • Claude Opus 5
    TextVisionFiles1M
  • Claude Opus 5 (Fast)
    TextVisionFiles1M
Open Weights

None

usArcee AI
Closed Weights

None

Open Weights
  • Arcee AI: Trinity Large Thinking
    Text262K
usDeep Cogito
Closed Weights

None

Open Weights
  • Deep Cogito: Cogito v2.1 671B
    Text128K
usGoogle
Closed Weights
  • Google: Gemini 3 Flash Preview
    TextVisionFilesAudioVideo1M
  • Google: Gemini 3.1 Flash Lite
    TextVisionVideoFilesAudio1M
  • Google: Gemini 3.1 Flash Lite Preview
    TextVisionVideoFilesAudio1M
  • Google: Gemini 3.1 Pro Preview
    AudioFilesVisionTextVideo1M
  • Google: Gemini 3.1 Pro Preview Custom Tools
    TextAudioVisionVideoFiles1M
  • Google: Gemini 3.5 Flash
    TextVisionVideoFilesAudio1M
  • Google: Gemini 3.5 Flash Lite
    TextVisionVideoFilesAudio1M
  • Google: Gemini 3.6 Flash
    TextVisionVideoFilesAudio1M
  • Google: Lyria 3 Clip Preview
    TextVision1M
  • Google: Lyria 3 Pro Preview
    TextVision1M
  • Google: Nano Banana (Gemini 2.5 Flash Image)
    VisionText33K
  • Google: Nano Banana 2 (Gemini 3.1 Flash Image Preview)
    VisionText66K
  • Google: Nano Banana 2 (Gemini 3.1 Flash Image)
    VisionText131K
  • Google: Nano Banana 2 Lite (Gemini 3.1 Flash Lite Image)
    VisionText66K
  • Google: Nano Banana Pro (Gemini 3 Pro Image Preview)
    VisionText66K
  • Google: Nano Banana Pro (Gemini 3 Pro Image)
    VisionText131K
Open Weights
  • Google: Gemma 4 26B A4B
    VisionTextVideo262K
  • Google: Gemma 4 31B
    VisionTextVideo262K
usIBM
Closed Weights

None

Open Weights
  • IBM: Granite 4.0 Micro
    Text131K
  • IBM: Granite 4.1 8B
    Text131K
usInception
Closed Weights
  • Inception: Mercury 2
    Text128K
Open Weights

None

usMeta (Muse)
Closed Weights
  • Meta: Muse Spark 1.1
    TextVisionVideoFilesAudio1M
  • Meta: Muse Spark 1.2
    TextVisionVideoFilesAudio1M
Open Weights

None

usNous Research
Closed Weights

None

Open Weights
  • Nous: Hermes 4 405B
    Text131K
  • Nous: Hermes 4 70B
    Text131K
usNVIDIA
Closed Weights

None

Open Weights
  • NVIDIA: Nemotron 3 Nano 30B A3B
    Text262K
  • NVIDIA: Nemotron 3 Super
    Text1M
  • NVIDIA: Nemotron 3 Ultra
    Text512K
usOpenAI
Closed Weights
  • OpenAI: GPT Audio
    TextAudio128K
  • OpenAI: GPT Audio Mini
    TextAudio128K
  • OpenAI: GPT-5
    TextVisionFiles400K
  • OpenAI: GPT-5 Image
    VisionTextFiles400K
  • OpenAI: GPT-5 Image Mini
    FilesVisionText400K
  • OpenAI: GPT-5 Mini
    TextVisionFiles400K
  • OpenAI: GPT-5 Nano
    TextVisionFiles400K
  • OpenAI: GPT-5 Pro
    VisionTextFiles400K
  • OpenAI: GPT-5.1
    VisionTextFiles400K
  • OpenAI: GPT-5.1-Codex
    TextVision400K
  • OpenAI: GPT-5.1-Codex-Max
    TextVision400K
  • OpenAI: GPT-5.1-Codex-Mini
    VisionText400K
  • OpenAI: GPT-5.2
    FilesVisionText400K
  • OpenAI: GPT-5.2 Chat
    FilesVisionText128K
  • OpenAI: GPT-5.2 Pro
    VisionTextFiles400K
  • OpenAI: GPT-5.2-Codex
    TextVision400K
  • OpenAI: GPT-5.3 Chat
    TextVisionFiles128K
  • OpenAI: GPT-5.3-Codex
    TextVisionFiles400K
  • OpenAI: GPT-5.4
    TextVisionFiles1M
  • OpenAI: GPT-5.4 Image 2
    VisionTextFiles272K
  • OpenAI: GPT-5.4 Mini
    FilesVisionText400K
  • OpenAI: GPT-5.4 Nano
    FilesVisionText400K
  • OpenAI: GPT-5.4 Pro
    TextVisionFiles1M
  • OpenAI: GPT-5.5
    FilesVisionText1M
  • OpenAI: GPT-5.5 Pro
    FilesVisionText1M
  • OpenAI: GPT-5.6 Luna
    FilesVisionText1M
  • OpenAI: GPT-5.6 Luna Pro
    FilesVisionText1M
  • OpenAI: GPT-5.6 Sol
    FilesVisionText1M
  • OpenAI: GPT-5.6 Sol Pro
    FilesVisionText1M
  • OpenAI: GPT-5.6 Terra
    FilesVisionText1M
  • OpenAI: GPT-5.6 Terra Pro
    FilesVisionText1M
Open Weights

None

usPerceptron
Closed Weights
  • Perceptron: Perceptron Mk1
    TextVisionVideo33K
Open Weights

None

usPerplexity
Closed Weights
  • Perplexity: Sonar Pro Search
    TextVision200K
Open Weights

None

usPoolside
Closed Weights

None

Open Weights
  • Poolside: Laguna S 2.1
    Text1M
  • Poolside: Laguna XS 2.1
    Text262K
usReka AI
Closed Weights

None

Open Weights
  • Reka Edge
    VisionTextVideo16K
usRelace
Closed Weights

None

Open Weights
  • Relace: Relace Apply 3
    Text256K
  • Relace: Relace Search
    Text256K
usThinking Machines
Closed Weights

None

Open Weights
  • Thinking Machines: Inkling
    TextVisionAudio1M
  • Thinking Machines: Inkling Small
    TextVisionAudio524K
usxAI
Closed Weights
  • SpaceXAI: Grok 4.20
    TextVisionFiles2M
  • SpaceXAI: Grok 4.20 Multi-Agent
    TextVisionFiles2M
  • SpaceXAI: Grok 4.3
    TextVisionFiles1M
  • SpaceXAI: Grok 4.5
    TextVisionFiles500K
  • SpaceXAI: Grok Build 0.1
    TextVisionFiles256K
Open Weights

None

frMistral AI
Closed Weights
  • Mistral: Mistral Medium 3.1
    TextVisionFiles131K
Open Weights
  • Mistral: Ministral 3 14B 2512
    TextVision262K
  • Mistral: Ministral 3 3B 2512
    TextVision131K
  • Mistral: Ministral 3 8B 2512
    TextVision262K
  • Mistral: Mistral Large 3 2512
    TextVisionFiles262K
  • Mistral: Mistral Medium 3.5
    TextVisionFiles262K
  • Mistral: Mistral Small 4
    TextVision262K
  • Mistral: Voxtral Small 24B 2507
    TextAudioFiles32K
ilAI21 Labs
Closed Weights

None

Open Weights
  • AI21: Jamba Large 1.7
    Text256K
cnAlibaba (Qwen)
Closed Weights
  • Qwen: Qwen3 Coder Flash
    Text1M
  • Qwen: Qwen3 Coder Plus
    Text1M
  • Qwen: Qwen3 Max
    Text262K
  • Qwen: Qwen3 Max Thinking
    Text262K
  • Qwen: Qwen3.6 Flash
    TextVisionVideo1M
  • Qwen: Qwen3.6 Max Preview
    Text262K
  • Qwen: Qwen3.6 Plus
    TextVisionVideo1M
  • Qwen: Qwen3.7 Flash
    TextVisionVideo1M
  • Qwen: Qwen3.7 Max
    Text1M
  • Qwen: Qwen3.7 Plus
    TextVision1M
Open Weights
  • Qwen: Qwen3 30B A3B Thinking 2507
    Text82K
  • Qwen: Qwen3 Coder Next
    Text262K
  • Qwen: Qwen3 Next 80B A3B Instruct
    Text262K
  • Qwen: Qwen3 Next 80B A3B Thinking
    Text262K
  • Qwen: Qwen3 VL 235B A22B Instruct
    TextVision262K
  • Qwen: Qwen3 VL 235B A22B Thinking
    TextVision131K
  • Qwen: Qwen3 VL 30B A3B Instruct
    TextVision262K
  • Qwen: Qwen3 VL 30B A3B Thinking
    TextVision262K
  • Qwen: Qwen3 VL 32B Instruct
    TextVision131K
  • Qwen: Qwen3 VL 8B Instruct
    VisionText262K
  • Qwen: Qwen3 VL 8B Thinking
    VisionText131K
  • Qwen: Qwen3.5 397B A17B
    TextVisionVideo262K
  • Qwen: Qwen3.5-122B-A10B
    TextVisionVideo262K
  • Qwen: Qwen3.5-27B
    TextVisionVideo262K
  • Qwen: Qwen3.5-35B-A3B
    TextVisionVideo262K
  • Qwen: Qwen3.5-9B
    TextVisionVideo262K
  • Qwen: Qwen3.6 27B
    TextVisionVideo262K
  • Qwen: Qwen3.6 35B A3B
    TextVisionVideo262K
  • Qwen: Qwen3.8 Max
    TextVisionVideo1M
cnByteDance
Closed Weights
  • Seed: Seed 1.6
    VisionTextVideo262K
  • Seed: Seed 1.6 Flash
    VisionTextVideo262K
  • Seed: Seed-2.0-Lite
    TextVisionVideo262K
  • Seed: Seed-2.0-Mini
    TextVisionVideo262K
Open Weights

None

cnDeepSeek
Closed Weights

None

Open Weights
  • DeepSeek: DeepSeek V3.1
    Text164K
  • DeepSeek: DeepSeek V3.1 Terminus
    Text164K
  • DeepSeek: DeepSeek V3.2
    Text164K
  • DeepSeek: DeepSeek V3.2 Exp
    Text164K
  • DeepSeek: DeepSeek V4 Flash 0423
    Text1M
  • DeepSeek: DeepSeek V4 Flash 0731
    Text1M
  • DeepSeek: DeepSeek V4 Pro
    Text1M
cnMiniMax
Closed Weights
  • MiniMax: MiniMax M2-her
    Text66K
Open Weights
  • MiniMax: MiniMax M2
    Text205K
  • MiniMax: MiniMax M2.1
    Text205K
  • MiniMax: MiniMax M2.5
    Text205K
  • MiniMax: MiniMax M2.7
    Text205K
  • MiniMax: MiniMax M3
    TextVisionVideo1M
cnMoonshot AI
Closed Weights

None

Open Weights
  • MoonshotAI: Kimi K2 0905
    Text262K
  • MoonshotAI: Kimi K2 Thinking
    Text262K
  • MoonshotAI: Kimi K2.5
    TextVision262K
  • MoonshotAI: Kimi K2.6
    TextVision262K
  • MoonshotAI: Kimi K2.7 Code
    TextVision262K
  • MoonshotAI: Kimi K3
    TextVision1M
cnXiaomi
Closed Weights

None

Open Weights
  • Xiaomi: MiMo-V2.5
    TextAudioVisionVideo1M
  • Xiaomi: MiMo-V2.5-Pro
    Text1M
cnZ.ai
Closed Weights

None

Open Weights
  • Z.ai: GLM 4.5V
    TextVision66K
  • Z.ai: GLM 4.6
    Text205K
  • Z.ai: GLM 4.6V
    VisionTextVideo131K
  • Z.ai: GLM 4.7
    Text205K
  • Z.ai: GLM 4.7 Flash
    Text203K
  • Z.ai: GLM 5
    Text205K
  • Z.ai: GLM 5 Turbo
    Text203K
  • Z.ai: GLM 5.1
    Text205K
  • Z.ai: GLM 5.2
    Text1M
  • Z.ai: GLM 5V Turbo
    VisionTextVideo203K
krUpstage
Closed Weights
  • Upstage: Solar Pro 3
    Text131K
Open Weights

None