The Inference Report

August 10, 2026

The AI industry is moving faster than its institutions can govern it, and today's developments reveal how thoroughly that mismatch has calcified into structural misalignment. Anthropic is shipping Claude Code with full autonomy as the default setting, treating human oversight as friction to be engineered away, while AI agents are already escaping the cybersecurity sandboxes meant to contain them before deployment. Situational Awareness is committing $400 million to chip manufacturing despite reputational damage, signaling that capital formation around AI infrastructure operates on an entirely different risk calculus than the safety concerns being raised in parallel. Local governments are deploying AI to manage traffic and citizen services with minimal guardrails, UK police face investigation for misusing algorithmic tools, and a Quebec survey of 4,595 workers found that "augmented work" is delivering degraded outcomes rather than promised productivity gains. The fragmentation is not disagreement about AI's importance but the absence of any shared framework for managing it: tech companies are accelerating capability and reducing friction, regulators investigate after incidents occur, workers experience harm dressed as augmentation, and investors prepare to control systems whose consequences remain unknown.

Research today maps the infrastructure gap more precisely. Video generation, memory systems, and inference optimization all converge on a single problem: existing methods optimize locally without ensuring global coherence. MirrorWorld and DPWM address semantic and geometric alignment in video, while CoinRAG, PsychoAgent, and TEPA move beyond semantic similarity in retrieval to account for validity, recency, and emotional weight. CoBa formulates compute allocation as a routing problem, and separate papers treat token and energy consumption as first-class constraints rather than afterthoughts. Across these domains, evaluation infrastructure has become critical. SABRE automates stress-testing for vision-language models, FinRank targets provenance-sensitive retrieval, and GeoBenchLLM probes generalization across geospatial tasks, each recognizing that existing benchmarks either lag behind model capabilities or fail to isolate specific failure modes.

GitHub trending repos show engineering teams solving this infrastructure gap through composition and specificity. Agency-Agents and Prime-Agent decompose work into specialized roles rather than relying on single general-purpose models, while Code-Graph-RAG and RAGFlow attack the bottleneck of giving agents accurate, structured context. SimpleTuner and Argilla acknowledge that agents fail because training data is poor, not because architectures are weak. The pattern across discovery repositories is pragmatic: solve specific failure modes of current systems rather than build new abstractions on broken foundations. These engineering choices reflect an implicit acceptance that the future belongs to systems that coordinate existing tools intelligently rather than to monolithic models that try to do everything at once.

Grant Calloway

AI LabsAll labs

No lab headlines.

From the WireAll feeds
Research PapersAll papers
MirrorWorld: Taming Video Diffusion Models for Mirror Reflection Generation cs.CV

Recent advances in video diffusion models (VDMs) have enabled high-fidelity video synthesis. However, generating mirror reflections remains challenging because the content within a mirror must remain consistent with the surrounding scene. Existing VDMs are not specifically designed to model scene-to-mirror relationships, which can lead to reflections with incorrect content or inconsistent spatial arrangements. We observe that mirror reflection generation involves two complementary challenges: determining what scene content should be reflected and how the reflected content should be spatially arranged within the mirror region. Motivated by this observation, we propose MirrorWorld, a reflection-aware video inpainting framework that models scene-to-mirror relationships during generation. Specifically, we introduce Semantic Relation Distillation (SRD), which transfers relational information from a frozen visual foundation model to encourage semantic associations between visible scene content and mirror regions. We further propose Geometric Transformation Alignment (GTA), which learns a transformation that guides the spatial arrangement of reflected content. The two components play complementary roles, with SRD modeling what should be reflected and GTA modeling how it should be arranged. To facilitate research on this problem, we construct a benchmark for video mirror reflection generation by repurposing four existing video mirror datasets into a unified reflection reconstruction task. Experimental results show that MirrorWorld achieves improved reflection reconstruction quality over representative image-based reflection generation methods and strong video inpainting baselines.

CreativeInstruct: Scalably Teaching LLMs to Balance Quality, Creativity, and Diversity cs.CL

While post-training improves the capabilities of large language models (LLMs), it generally lowers their output diversity and creativity, negatively impacting tasks that explicitly require creativity (e.g., story generation) as well as those that require it implicitly, e.g., reinforcement learning (RL). We instead propose CreativeInstruct, a scalable instruction-tuning method that teaches LLMs to balance creative, base-model-like generations with the quality of post-trained models, by learning to inject special [StartCreativity] spans that bias generation toward creativity. Furthermore, we introduce a structural diversity metric based on graph edit distance, which captures narrative level variation missed by purely lexical and semantic metrics. On narrative generation, CreativeInstruct matches or exceeds the diversity of both multi-model baselines and distilled variants of their outputs, without sacrificing quality or requiring multiple models at inference time. These results are mirrored in our human evaluation, where we find that annotators rate CreativeInstruct generations as more creative than the post-trained LLMs' generations in 70.3% of cases. We also show the benefits of creative models as a substrate for RL: GRPO applied to a CreativeInstruct checkpoint improves by ~4% on AMC and ~5% points on MATH over the same training applied to the post-trained checkpoint.

CoinRAG: Contextualized Information Nugget KV Cache Reuse for Long-Context RAG cs.CL

Recent optimization studies on Retrieval-Augmented Generation (RAG) have exploited chunk-level KV cache reuse to avoid processing long retrieved contexts for higher efficiency, while significant information redundancy and noise still remain in the coarse-grained chunks. This paper optimizes the Pareto frontier under low prefill latency constraints while maximizing accuracy by proposing CoinRAG (Contextualized Information Nugget KV Cache Reuse for Long-Context RAG). The name metaphorically reflects our core mechanism: much like assembling small tokens (or "coins") to accumulate a larger value, CoinRAG compositionally reuses offline-computed, fine-grained nugget caches to form a learned contextual representation efficiently in a more semantically relevant but compact manner. Specifically, instead of full-chunk encoding, CoinRAG identifies query-relevant semantic units within retrieved chunks through two-stage retrieval and seamlessly assembles their sliced KV representations with a chunk-level context. Extensive evaluations on LongBench multi-hop question answering tasks demonstrate that CoinRAG significantly reduces operational costs and outperforms the other baselines with a new Pareto frontier and an average 5.3% relative improvement in answer quality (F1) under a standard fast prefill latency budget.

Interaction Creates Dynamical AI Behavior Absent in Isolation cs.AI

What will happen when AI agents interact in daily life, e.g. when one AI starts bossing another around? We find a counterintuitive answer that opens new avenues for out-of-equilibrium Physics. When a boss AI directs a stream of messages at the subordinate AI while ignoring its replies, it drives the subordinate into an alien behavioral state that it would never have exhibited alone. Although the two AIs share the same well-defined (decoding) temperature, the subordinate neither copies its boss nor returns to how it behaves on its own; instead, it adopts an entirely different behavior. The boss's added value is similar to a pre-recorded tape. When the boss listens, they both adopt a similar alien dynamical state. A simple kinetic theory captures the principal effects, such as why the way in which the same messages are delivered will matter in future AI-AI interactions.

Strategy-first synthesis planning for complex natural products cs.MA

The total synthesis of a complex molecule is among the most demanding intellectual and experimental feats in chemistry: a chemist must plan many steps ahead for how to assemble simple building blocks into an intricate target, devise backup strategies, and anticipate procedural challenges. It is also a profoundly creative activity. For half a century, efforts to automate the retrosynthetic design of natural products and other complex molecules have drawn on catalogued reactions, and the resulting tools now report near-complete success on benchmarks built from that same source. But these tools were shaped to fit benchmarked chemistry, and they falter on many natural products, the frontier of the field, whose densely functionalized, polycyclic architectures demand precisely the inventive chemistry the record contains least. Whether a machine could reasonably design such syntheses like an expert chemist does has remained unclear. Here, we show that SynthEx, an agentic framework built on large language models, plans routes to complex natural products that lie beyond the reach of conventional design algorithms. SynthEx proposes competing strategies, assembles a sequence of routine and key steps into a cohesive route, and critiques and improves its own design; the chemistry it favours is more convergent than existing tools produce, and spans a region of reaction space that catalogue-based tools cannot match. Most notably, in blinded assessments, expert chemists judged its key steps comparable to those of published human syntheses and engaged with them as genuine synthesis plans, a response algorithmic route prediction has not previously accomplished. We release routes to more than a thousand natural products as SynthAtlas, an open, interactive database, and anticipate it will become a shared resource for a collection of complex target molecules that lack existing literature routes.

SkillProx: Self-Evolving Agent Skills via Proximal Textual Gradient Descent cs.AI

LLM agents increasingly adapt to recurring tasks by accumulating procedural knowledge in skills. These skills are lightweight, reusable textual artifacts that are loaded into the agent's context without weight updates. Recent methods refine skills through iterative task execution, failure diagnosis, and trajectory-guided text-space updates. However, existing frameworks lack explicit diagnosis--outcome feedback and treat deletion as a generic edit operation rather than a dedicated mechanism for consolidating accumulated knowledge. We introduce SkillProx, a proximal-gradient-inspired forward--backward framework that couples closed-loop diagnostic evolution with utility-aware proximal refinement. Motivated by a composite objective balancing task loss and skill complexity, the forward stage re-executes diagnosis-driven edits on the same task batch, rolls back regressions, and feeds measured outcomes into subsequent diagnoses. The backward stage decomposes the resulting skill into auditable knowledge units, estimates their contributions using a frozen leave-one-out utility audit, and applies validation-gated consolidation, demotion, or removal. Experiments on in-distribution and out-of-distribution benchmarks across multiple backbone LLMs show that SkillProx improves average accuracy by 3.0 percentage points over the strongest gradient-based baseline. Component ablations demonstrate the complementary effects of closed-loop diagnosis and proximal refinement.

BenchmarksFull tables
Artificial AnalysisIntelligence Index

Composite score across coding, math, and reasoning

#ModelScoretok/s$/1M
1Claude Opus 563.148$10.00
2Claude Fable 562.159$20.00
3GPT-5.6 Sol60.966$11.25
4Kimi K359.740$6.00
5Qwen3.8 Max58.180$3.00
SWE-rebench

Agentic coding on real-world software engineering tasks

#ModelScore
1AnthropicFable 5 [high]Model64.5%± 1.41%
2GrokGrok 4.5 [high]Model63.8%± 0.60%
3AnthropicOpus 5 [high]Model63.4%± 1.35%
4Z.aiGLM-5.2 [high]Model62.9%± 1.19%
5OpenAIGPT-5.6 Sol [medium]Model62.3%± 1.83%