The Inference Report

October 14, 2026

Disney acquired Character.AI's assets for $20 million after the platform filed for bankruptcy, exposing the gap between first-mover advantage and sustainable business. Character.AI had built brand in interactive chatbots but lacked defensible technology or unit economics. Google, by contrast, is treating distribution itself as the asset by hosting AI-generated Android apps in the Play Store. Microsoft's Decision-1 model fragments general-purpose LLMs into task-specific tools where latency and cost matter more than conversational fluency. The consolidation happening now is sorting between builders shipping products and companies seeking regulatory moats.

Infrastructure and inference are where the real competition lives. Google's Gemini 4 Argon with 1M token output and Meta's Muse Wonder at $4 per million tokens show pricing competition intensifying at the inference level. NVIDIA is making a structural bet on localization, deploying $250 million in UK compute for agentic safety research and positioning consumer PCs as personal supercomputers with 128GB unified memory. Anthropic's Singapore office and Google DeepMind's collaboration with Singapore's GovTech signal that regulatory relationships and localized model fine-tuning are becoming competitive differentiators. The companies winning are those reducing friction between model and user through cheaper inference, edge deployment on NPUs, or bundled subscription stacks.

Security and control are emerging as the real competitive battlegrounds in enterprise deployment. Pluto Security raised $42 million to address the fact that giving employees access to AI tools creates security holes companies cannot easily patch. American Express is introducing a framework to prevent AI agents from making unauthorized purchases. An OpenAI employee allegedly used a chatbot to help plant a recording device in the office, and a federal judge ordered OpenAI to hand over hiring records in an Apple trade secrets case. These incidents reflect the reality that AI systems are now embedded in workflows where the incentives for misuse and unauthorized action are immediate and concrete. The companies that build tooling to audit, control, and constrain AI agent behavior within their organizations are solving a problem that will only grow as deployment accelerates.

In research and development, the pattern mirrors what's happening in the market. Papers cluster around agentic systems that decouple reasoning from execution to improve efficiency, representation-based approaches that learn task-appropriate embeddings, and feedback-driven frameworks that refine both model weights and system scaffolding. On GitHub, trending projects bifurcate between infrastructure for agents and tools to control them versus infrastructure for the data those agents consume. Once a capability exists, the next move is making it run locally and cheaply. The gap between trending and discovery isn't hype; it's maturity. Agents are becoming commodity infrastructure. What separates working deployments from experiments is whether you've solved data pipelines, verification, and routing.

Grant Calloway

AI LabsAll labs
From the WireAll feeds
Research PapersAll papers
ChunkAct: Action Chunking for Agentic Robotics cs.RO

Agentic robotics places a large language model (LLM) agent in the robot control loop, where it composes perception, motion, and vision-language-action (VLA) tools under the guidance of a memory and thereby generalizes to new tasks without retraining. This generality comes at a steep price in efficiency. Every primitive requires a round of LLM reasoning over the full interaction history, so the cost of an episode grows with the number of primitives. We find this reasoning largely redundant: once a sub-goal is chosen, its primitives follow a routine already prescribed by memory. We present ChunkAct, which introduces action chunking to agentic robotics. Online, a single call launches a chunk of chained primitives, which executes autonomously and returns control only upon failure. Offline, ChunkAct compiles the memory into these chunks, so execution is memory-free at test time and the planner is reserved for decisions that require reasoning. LLM computation therefore scales with the number of decisions rather than the number of primitives. On LIBERO-Pro, ChunkAct improves task success by 5.0 points over the state of the art in agentic robotics while requiring 2.9x fewer LLM calls, 4.4x fewer input tokens, and 2.3x fewer output tokens.

Cepheid: Decoupling Scale from Structure for Cross-Family Motion Completion cs.CV

Sparse-to-dense motion completion recovers dense mesh motion from sparse vertex displacements. Residual priors trained on one geometry family frequently fail to beat parameter-free harmonic extension off-family. Moreover, cross-family training meets a scaling barrier: residual amplitude varies by more than an order of magnitude across geometry families and collapses as observations become denser. Since this scale depends on unknown target motion, it cannot be measured directly at test time. We decouple residual structure from physical scale by learning a dimensionless prior, estimating amplitude from observables and a lightweight correction fitted only on training sources. Our unified model surpasses harmonic extension across all evaluated families, including unseen cloth and legged bodies, without skeletons, registration, or cross-mesh correspondence. The same prior applies without retraining to point-tracked animal video and a robot grasping a soft body. Project page: https://su-terry.github.io/cepheid-website/

What Matters in Quality-Aware VLA Pretraining: A Benchmark and Empirical Study cs.RO

How should demonstration quality be used during vision-language-action (VLA) pretraining to improve performance after target-task fine-tuning? We compare weighting, filtering, and conditioning across reward definitions and label granularities using 5,000 naturally suboptimal human demonstrations and 24 target tasks. Within each VLA, we match demonstrations and training budgets. Additional comparisons examine pretraining data size and the roles of quality tags during fine-tuning and inference. Across three VLAs, we find that approach-aware episode conditioning improves mean success over plain behavioral cloning; conditioning and filtering favor episode and chunk labels, respectively, on average, with model-dependent reversals; and constant-tag fine-tuning improves mean success after conditioned pretraining with either tagged or untagged inference. We introduce AXIS-Bench to support these controlled comparisons. Built on crowdsourced simulation demonstrations, it provides recorded object and contact states for recomputing quality labels on shared trajectories. Replayable trajectories support workspace-aligned rendering and user-defined real-world target tasks. In our real-world experiment, simulation pretraining raises success from 9.6\% to 31.7\%. Project page: https://axis-bench.github.io/.

Tev: Scaling Long-Horizon Agentic Environments with Dense Progress Rewards cs.CL

Long-horizon agents have drawn growing attention for their ability to work autonomously -- from hours to days -- on economically valuable tasks, a capability essential to automated discovery and recursive self-improvement (RSI). Yet open-source models still struggle on long-horizon tasks, largely for lack of both training data and a working recipe, and scaling both is hard: long, complex tasks are difficult to curate and verify, and their rewards are sparse. We address both. First, we introduce Tev-Gym, the first long-horizon agent training dataset with verifiable, dense, progressive rewards -- 1,170 verified task environments across 7 domains. It is built on a latent-world-first approach that first constructs a latent world: a complete and correct hidden specification of the task domain, workflow, and expected state after each step. Each task is then progressively rendered from this specification into an agent-facing environment, enabling controllable complexity and a natural progress metric. Second, we turn this metric into a training recipe: via progress-potential reward shaping (PPRS), we convert progress into a dense per-step reward that improves training efficiency and makes otherwise-intractable tasks trainable. Training with this recipe yields Tev-27B, which achieves substantial gains on the Agents' Last Exam computing and math sciences domains (ALE-CM), matching GPT-6 Astra and Claude Opus 5 at Pass@5. Despite training only on ALE-related data, it generalizes to the Terminal-Bench (TB) 3.0 and 4.0 subsets, surpassing GLM 5.2 and Gemini 3.7 Flash, and reaches Claude Opus 4.8-level performance on middle-horizon tasks such as TB 2.1.

Data Free Training of Diffusion Models for Lattice Field Theories hep-lat

Sampling equilibrium field configurations remains a major computational bottleneck in lattice field theory, motivating the development of generative samplers that can produce independent configurations. Diffusion models are promising for this purpose, but their standard denoising score matching objective requires samples from the target distribution, seemingly reintroducing the original sampling problem. Here, we show that diffusion models can instead be trained from their own generated samples using the target score identity, provided access to the unnormalized probability density. Importance-weighted formulations of this identity yield a consistent target throughout training, while unweighted variants define a self-consistent fixed-point training scheme. We benchmark the different approaches in two-dimensional \(φ^4\) theory and identify effective choices that enable efficient training and sampling across the symmetric, critical, and broken phases. Ultimately, our data-free training approach achieves comparable performance to training on HMC reference data.

DoubtLess: Training-Free Contrastive Decoding for Efficient Reasoning cs.CL

Reasoning models achieve strong performance through long chains of thought (CoT), but often spend more tokens than needed to solve a problem. Existing ways to shorten the CoT require additional training for each model, add a fixed steering vector to the model's hidden states, or use decoding heuristics such as stopping early or banning words like "wait", which can reduce accuracy. We propose DoubtLess, a training-free decoding method in which a much smaller reasoning model steers the large one towards brevity. The small model reads the large model's CoT so far twice, once prompted to be brief (the brief thinker) and once prompted to be verbose (the verbose thinker), and the difference between its two logit vectors, scaled by a strength, is added to the large model's logits at every step of the CoT. On seven benchmarks of competition mathematics, graduate-level science and competitive programming, DoubtLess shortens the CoT of Qwen3-32B by 31% with unchanged accuracy, outperforming five inference-time baselines. We also show that DoubtLess reduces thinking tokens per turn by 20% in a self-debugging coding agent with unchanged task performance. It also generalizes to two other model families with unchanged accuracy. When combined with training-based compression, it further shortens the CoT of a model already trained for brevity. Ablations and behavioral analysis show that DoubtLess reduces repeated checking, with most token savings coming after the correct answer first appears in the CoT. Our code is available at https://github.com/leoluolol/DoubtLess.

BenchmarksFull tables
Artificial AnalysisIntelligence Index

Composite score across coding, math, and reasoning

#ModelScoretok/s$/1M
1Claude Opus 5.557.696$8.00
2Claude Sonnet 5.556133$4.00
3Muse Wonder Full55.80$0.00
4Claude Fable 5.153.465$20.00
5GPT-6 Astra52.752$20.00
SWE-rebench

Agentic coding on real-world software engineering tasks

#ModelScore
1AnthropicFable 5 [high]Model64.5%± 1.41%
2GrokGrok 4.5 [high]Model63.8%± 0.60%
3AnthropicOpus 5 [high]Model63.4%± 1.35%
4Z.aiGLM-5.2 [high]Model62.9%± 1.19%
5OpenAIGPT-5.6 Sol [medium]Model62.3%± 1.83%