The Inference Report

July 15, 2026

New York's one-year data center moratorium and Australia's announcement of an AI oversight office arrived within hours of each other, signaling that the compute arms race has entered a new phase where political will is beginning to constrain infrastructure deployment. The economic sorting this creates is already visible: IBM's stock fell 25 percent as customers shifted spending toward servers and AI infrastructure, while ASML raised forecasts on chipmaking demand. Capital is moving at scale away from legacy IT toward the infrastructure layer, and the losers are already marked. What distinguishes this moment is that the money flow is no longer theoretical. It is measurable, visible, and accelerating.

The frontier-model narrative that defined the past two years is fracturing beneath this infrastructure reality. Hugging Face's CEO argued that most production AI now runs on open models rather than frontier systems, while Reflection AI secured a one-billion-dollar compute deal with Nebius months after founding, evidence that access to chips matters more than access to the latest closed model. DeepMeal's Demis Hassabis called for an independent standards body modeled on FINRA to test frontier models, a proposal that functions as gatekeeping by legitimizing models that pass inspection while creating friction for competitors. OpenAI pushed back on Apple's trade secret lawsuit, and Meta faced claims its layoff decisions were made by AI rather than humans. Each story reveals the same tension: companies want to deploy AI at scale without accountability, while regulatory pressure and litigation are beginning to impose costs on that freedom.

The labs have largely stopped competing on headline capabilities. NVIDIA and OpenAI both pivoted enterprise messaging toward efficiency metrics, useful work per dollar and performance per watt, signaling that raw model power has stopped being the differentiator. AMD is moving parallel, emphasizing local inference on consumer hardware. Anthropic committed ten million dollars to Canadian research while publishing an economic index on Claude usage in Canada, a move that looks less like research and more like building policy relationships ahead of regulatory moves. AWS marked the Builder Center's one-year anniversary as a platform play that shifts competition from model access to developer tooling and community lock-in. The infrastructure, efficiency story, and institutional relationships now determine where dollars actually flow.

The consumer layer is where incoherence shows most clearly. OpenAI is building a screenless speaker with mechanical parts to feel like a companion. Apple released iOS 27 with revamped Siri. Superhuman's auto-draft email feature required minimal editing in testing. Yet Lorde called AI glasses unsexy, and Anthropic's latest ad was described as creeping people out. YouTube and X have become gateways to deepfake apps generating nonconsensual images for a dollar per image. The infrastructure is being built, the models are being deployed, and consumer friction is rising in real time. The products work better than they did a year ago, but the cultural permission structure is fragmenting.

Grant Calloway

AI LabsAll labs
From the WireAll feeds
Research PapersAll papers
Do AI Agents Know When a Task Is Simple? Toward Complexity-Aware Reasoning and Execution cs.AI

Large language model (LLM) agents increasingly automate multi-step engineering and informatics workflows, yet they rarely ask how much effort a task actually requires. They often follow a maximum-context-first strategy--re-reading files and dependencies they have already seen--turning a one-line edit into a small code-base audit. We argue the missing capability is task-aware execution-scope estimation: judging a task's difficulty, the information it truly needs, and the shortest reliable path before committing budget. We formalize minimum-sufficient execution and the Agent Cognitive Redundancy Ratio (ACRR), and propose E3 (Estimate, Execute, Expand): the agent estimates an initial operating point, executes a minimum viable path, and expands scope only when verification fails. On MSE-Bench--a deterministic benchmark of 121 edits in a capability-controlled simulator--E3 matches the strongest baseline's 100% success while cutting cost by 85%, tokens by 91%, and inspected files by 92%, and further beats a strong adaptive retrieval baseline by 16%; the gains survive held-out instruction wording and essentially every cost weighting. A companion real-model harness (LLM-Case) corroborates the effect on a live gpt-4o agent editing a real open-source library, with every candidate patch graded by actually running the project's real pytest suite against a measured oracle: the over-reading is milder but real, and E3 is the leanest and fastest policy at comparable task success--its one shortfall a provider rate-limit, not a wrong edit. We frame this as a controlled probe of execution redundancy, not a measurement of any deployed agent, and position task-aware execution as a step toward engineering-grounded AI (EGAI)--agents whose effort is anchored in the engineering reality of the task. We release the framework and benchmark.

The Seriality Gap in Video Diffusion Models cs.LG

When one ball strikes another, then another, video models should predict the consequences of each bounce. In controlled experiments on multi-ball hard-sphere dynamics, we find that the performance of standard bidirectional video diffusion degrades as the causal chain lengthens, even when provided more denoising steps. In a length-matched single-ball control, where ball-ball interactions are absent, the degradation largely disappears, isolating dependent-event structure rather than video length as the cause. Across intervention studies, methods that increase effective serial computation improve performance disproportionately, including autoregressive/blockwise generation and architectural depth. We identify this pattern as the seriality gap: a mismatch between tasks requiring growing serial computation and video diffusion models whose denoising loop does not provide scalable serial compute. We then prove that, for deterministic video prediction, denoising steps do not add serial computation beyond the backbone, indicating a structural obstacle for video diffusion on serial reasoning and simulation tasks.

TerraZero: Procedural Driving Simulation for Zero-Demonstration Self-Play at Scale cs.LG

Training robust autonomous driving agents requires a simulator that is fast enough for reinforcement learning at scale, realistic enough to ground behavior in real-world map structure, and diverse enough to cover the safety-critical long tail that logged data rarely contains. We present TerraZero, a procedural driving simulator and self-play training stack. A configurable C engine runs simulation on the CPU and policy inference on the GPU over a zero-copy path, sustaining 1.3M agent-steps per second on a single server-grade GPU, far faster than existing object-level simulators, while keeping fidelity lighter single-agent systems omit: heterogeneous agents, multiple dynamics models, and full traffic-rule enforcement. TerraZero treats logged data only as a source of real-world map geometry, populating each map with randomized rule-based road users and signal controllers and randomizing agent dynamics, rewards, and sizes per episode, so a map yields an unbounded set of scenarios. Every reported policy trains from scratch by reinforcement learning alone on a compute-efficient self-play recipe across GPUs, with zero human demonstrations and no fallback planner at inference. Policies generalize zero-shot across cities and datasets, including emergent left-hand-traffic driving without explicit supervision. As an ego policy, TerraZero is the first fully learned policy to top the InterPlan long-tail benchmark, ahead of larger learned planners; on routine-driving val14 it ranks among the best approaches and is the safest, posting the best collision and time-to-collision scores. On Waymo Open Sim Agents realism the same recipe outperforms other demonstration-free methods and is competitive with the strongest reference-anchored self-play method. One stack serves both roles: driving policies across dynamics for cars and trucks, and sim agents that jointly control vehicles, pedestrians, and cyclists.

PalmClaw: A Native On-Device Agent Framework for Mobile Phones cs.CL

Large Language Model (LLM) agents have moved beyond generating responses to executing multi-step tasks by calling tools, observing the results, and iteratively deciding the next action. Most agent systems run on desktops or servers, which support tool use and task automation. Mobile devices are also important agent environments because they are widely accessible and contain users' data, sensors, and daily-use applications. Existing mobile agents mainly operate smartphones through graphical user interface (GUI) actions such as tapping, swiping, and typing, which often form long, interface-dependent sequences, cannot directly access device capabilities, and make execution boundaries difficult to define. We present \textbf{PalmClaw}, an open-source agent framework that runs natively on mobile phones and manages the sessions, memory, skills, tools, and agent loop directly on the device. PalmClaw exposes device capabilities as device tools with explicit arguments, structured results, and clearly defined execution boundaries. This design enables agents to use mobile capabilities directly while keeping each action explicit and controlled. Experiments show an 11.5\% relative improvement in task success and a 94.9\% reduction in completion time over the strongest baseline, with lower setup burden and traces illustrating how execution boundaries are applied. Code is available at https://github.com/ModalityDance/PalmClaw.

A Shortcut to Statistically Steady-State Turbulence with Flow Matching physics.plasm-ph

Many nonlinear physical systems exhibit an initial transient phase in which perturbations grow before nonlinear interactions lead to a statistically steady state. While this saturated regime is of primary interest, direct numerical simulations must resolve the full transient dynamics before reaching it, incurring significant computational cost. In Computational Fluid Dynamics, reduced-order approaches such as Large Eddy Simulation mitigate computational cost by modeling small-scale dynamics, enabling tractable approximations of turbulent flows. In contrast, for systems such as gyrokinetics, comparably effective closures for the full dynamics are not generally available, and high-fidelity simulations remain necessary. Existing surrogate modeling approaches for these systems are autoregressive, hence they suffer from accumulating error. We instead propose to bypass explicit time evolution by directly modeling the distribution of saturated states under an ergodicity assumption, stating that ensemble averages over samples are equivalent to time averages of a single long simulation. We introduce GyroFlow, a latent generative model that directly estimates steady-state statistics of gyrokinetic turbulence in 5D phase space, without resolving the transient phase. GyroFlow generates saturated snapshots from noise, conditioned on dimensionless operating parameters and outperforms autoregressive, reduced-order, and other generative approaches, while providing substantial speedup. To evaluate generation quality we propose FGyD, a distributional metric computed in the latent space of a pretrained gyrokinetic model, and show that it correlates with downstream flux accuracy and solver convergence. Finally, GyroFlow can be used to warm-start the numerical code used to produce the data.

Software Supply Chains are Dead: Use-Case-Oriented Regeneration cs.SE

Modern software development relies on an increasingly doubtful premise: that the up-front implementation savings from adopting a dependency outweighs the maintenance costs. Two changes are reshaping the build-vs.-reuse calculus: software supply chain attacks have raised the cost of external reliance, while generative AI has lowered the cost of local implementation. We envision use-case-oriented regeneration as a new software sourcing paradigm that shifts the supply chain from external trust to local verification. We evaluate an agentic workflow that synthesizes only the specific slice of dependency functionality that a repository exercises. Our measurements across 180 repository-dependency pairs suggest that this approach is feasible: the replacements preserve 99.8% of repository-observed behavior across baseline validation checks and reduce the exported API surface by 93%. Software sourcing may evolve toward verifiable repository-specific code synthesis, especially when the required functionality is narrow, stable, and well tested.

BenchmarksFull tables
Artificial AnalysisIntelligence Index

Composite score across coding, math, and reasoning

#ModelScoretok/s$/1M
1Claude Fable 559.969$20.00
2GPT-5.6 Sol58.971$11.25
3Claude Opus 4.855.757$10.00
4GPT-5.6 Terra55165$5.63
5GPT-5.554.885$11.25
SWE-rebench

Agentic coding on real-world software engineering tasks

#ModelScore
1OpenAIgpt-5.5-2026-04-23-xhighModel62.7%± 0.91%
2JunieJunieAgent61.6%± 0.64%
3OpenAICodexAgent60.4%± 1.37%
4AnthropicClaude CodeAgent59.6%± 1.98%
5OpenAIgpt-5.5-2026-04-23-mediumModel58.9%± 0.78%