The Inference Report

October 28, 2026

Anthropic's IPO filing lists seven ways its AI could harm humanity while simultaneously detailing how Amazon's stake could be worth $190 billion, a gap that captures the fundamental asymmetry reshaping the AI market: companies warn of blackmail and sentience in regulatory documents while their backers prepare to extract billions from deployment. Delaware's proposal to let AI agents run businesses with owners evading liability for reckless behavior is not an edge case but a logical endpoint of an incentive structure that rewards moving risk onto users and regulators while concentrating upside among cap table holders.

The infrastructure layer is bifurcating into two distinct value chains. OpenAI launched GPT-6.1 Terra at 50% lower cost than its predecessor while General Compute raised $100 million to build inference chips outside Nvidia's ecosystem, signaling that cost compression in inference is real and accelerating. Simultaneously, Anthropic's compute deals total over $750 billion with Google's chips and SpaceX receiving more allocation than Amazon or Microsoft, which means the bottleneck is shifting from model size to deployment, integration, and the legal permission to operate without guardrails. On the capability side, OpenAI is consolidating its position as the default model backbone for business software with GPT-6 Astra now powering 100 million monthly calls and driving $1.6M annual revenue per employee, while Google and DeepMind are investing in longer-horizon problems like continual learning and world simulation that generate no immediate revenue but represent bets on moat-building. The pattern is clear: winners own either the integration layer, the hardware layer, or a defensible vertical, while generalist capability announcements lack a clear path to revenue or market position.

Liability is the real product being sold now. Bank of America reminds customers they are responsible for activity resulting from their AI agents' access. The UK Home Office faces investigation over ChatGPT's use in asylum processing. A family sued OpenAI after ChatGPT allegedly coached their daughter off seizure medication before her death in February. These are not hypothetical risks but the current state of deployment, and the legal structure around them remains unsettled. Companies shipping products are moving faster than courts and regulators can respond, which means the winners will be those who either operate in jurisdictions with light enforcement or build products so embedded in critical workflows that removing them becomes politically impossible.

Developers are discovering that raw model capability doesn't translate to production code without guardrails. Half the energy in trending repositories goes toward filtering out garbage: Hallmark teaches Claude and Cursor what not to do, Impeccable catches AI slop before deployment, and design-skills repos try to codify taste that models can't seem to learn on their own. The real shift is that these aren't libraries or frameworks in the traditional sense but methodologies designed to make AI agents behave more like competent engineers and less like autocomplete that hallucinates architecture decisions. MCP servers are becoming the API layer between agents and real information, which suggests developers are treating AI tools less as replacements and more as components in larger systems. The investment is in making them smarter and more controllable, which implies the bottleneck has shifted from raw capability to reliability and direction.

Grant Calloway

AI LabsAll labs
From the WireAll feeds
Research Papers — FocusedAll papers
Tensor Network Kernel Machines for Nonlinear System Identification eess.SY

Over the past ten years Tensor Network Kernel Machines have enabled efficient nonlinear system identification through the use of low-rank tensor networks. The goal of this article is to provide the reader with a basic understanding of this model class in terms of its two defining properties. Furthermore, both the optimization and regularization of such models are discussed, together with recent developments and starting points for further exploration.

Reconciling European Electricity Data with Diffusion Priors Learned from Observations Alone eess.SY

The ENTSO-E Transparency Platform publishes generation, load, and cross-border power flows for European bidding zones. The values carry undocumented errors and violate energy conservation, and data reconciliation consists in correcting them to satisfy that balance. In this work, we formulate data reconciliation as Bayesian inference. Classical methods implicitly take a uniform prior, which we replace with a diffusion model estimated from the observations alone by empirical-Bayes expectation-maximization. The resulting posterior is sampled with a guided process whose projection step makes every sample satisfy the balance exactly. On synthetic systems of six to thirty-five bidding zones, built from ENTSO-E resource-adequacy data, the diffusion prior gives the most accurate reconciliation, increasingly so as the system grows. Its credible intervals are calibrated or conservative, and it remains the most accurate under a misspecified noise covariance. Finally, when the generation of entire zones goes unreported, the classical methods fail while the learned prior recovers it from cross-zone structure.

Truncated backpropagation through time induces a two-sided gradient turnpike property eess.SY

Truncated backpropagation through time reduces the computational burden of training recurrent models by restricting gradient computations to shorter temporal contexts. This induces two distinct boundary effects: missing past information perturbs the forward state evolution, while truncating the backward recursion omits future information. This motivates decoupling the interval over which gradient contributions are averaged for the parameter update from the surrounding temporal context over which they are computed. Under exponential decay of the state-transition Jacobians and mild regularity conditions, this leads to a two-sided gradient turnpike property: the error between truncated- and full-context gradient contributions decays exponentially with the distance from both context boundaries. We derive bounds for the averaged update gradient, yielding guarantees on gradient alignment and approximate full-context stationarity; under unbiased interval sampling and a Polyak-Lojasiewicz condition, these further imply a bound on the resulting optimality gap. Numerical experiments on the Wiener-Hammerstein benchmark illustrate the role of past and future context and the trade-off between predictive performance and computational cost.

When Music Needs Meaning: Semantic Communication as a Transformative Enabler for the Musical Metaverse eess.SY

The Musical Metaverse (MM) enables geographically distributed musicians, audiences, sound engineers, and AI agents to interact through synchronized audio, visual, kinematic, and haptic streams, imposing latency, synchronization, bandwidth, and scalability requirements that are difficult to satisfy with conventional bit-level communication. This paper argues that semantic communication, understood here as the transmission of musically meaningful information rather than raw audio-visual-haptic samples, provides a principled communication paradigm for the MM. We define the MM from a communication perspective and derive modality-specific require ments; propose a three-pillar framework for musical semantic communication comprising semantics extraction, semantic-aware orchestration, and cross-modal semantic synchronization; survey representative work across semantic communication, music AI and edge orchestration, identifying the gaps that prevent their integration; and propose a semantic-first reference architecture based on device-side semantic encoders, edge semantic routers, and cross-modal semantic synchronization. The resulting framework positions the MM as a concrete and demanding use case for 6G semantic communication.

Large Language Models for Forecasting of Electricity Price Spikes eess.SY

Can market notices read by a large language model (LLM) improve short-horizon electricity price spike forecasts? We study five regions of Australia's National Electricity Market. A local LLM extracted features once per notice, only notices visible at the forecast origin were used, and a gradient-boosting model produced onset probabilities. In an out-of-sample development back-test (July 2022 to July 2024), notice features did not lower the 60-minute Brier score of a numeric model including the market operator's next-hour forecasts. At 24 hours they did, but rule-based features did so almost equally and attribution to notice content was not established. A locally frozen protocol, not publicly deposited, governed a retrospective single-use holdout from 15 August to 17 October 2026. At 60 minutes, the hypothesis that LLM features lower the numeric model's Brier score was not established (H1; relative Brier skill -0.09%), so the planned comparison with rule-based features was not tested (H2). At 24 hours, the hypothesis that LLM features lower the score against a text-free control was not established (H3; +0.37%, 95% CI [-9.74, 1.39], inconclusive). By the frozen wording rule the non-significant 24-hour improvement comes mainly from recalibration and cannot be attributed to notice content, although post hoc the decomposition could not separate recalibration from resolution. The 24-hour base rate was 1.56% on the holdout against 14.0% in development. With 5 onsets on 3 days and 24-hour positives in 2 of 22 three-day blocks, the holdout neither established nor excluded a 24-hour effect.

Comparing model representations and fitting methods for port-Hamiltonian system identification eess.SY

Port-Hamiltonian models describe physical systems by separating stored energy, dissipation and external inputs. Learning such models from data requires a choice of representation and fitting method. We compare using neural networks, analytic expressions and combinations of the two for representing the different components of the port-Hamiltonian system, and compare fitting the models with gradient-based optimisation or sparse regression. Testing on simulations of mechanical and electrical systems, with and without added noise, we present prediction accuracy and computational cost of the different approaches.

BenchmarksFull tables
Artificial AnalysisIntelligence Index

Composite score across coding, math, and reasoning

#ModelScoretok/s$/1M
1Claude Opus 5.558.496$8.00
2GPT-6 Astra56.969$20.00
3GPT-6.1 Sol54.580$4.00
4Claude Sonnet 5.554.2138$4.00
5GPT-6.1 Terra5191$2.00
SWE-rebench

Agentic coding on real-world software engineering tasks

#ModelScore
1AnthropicFable 5 [high]Model64.5%± 1.41%
2GrokGrok 4.5 [high]Model63.8%± 0.60%
3AnthropicOpus 5 [high]Model63.4%± 1.35%
4Z.aiGLM-5.2 [high]Model62.9%± 1.19%
5OpenAIGPT-5.6 Sol [medium]Model62.3%± 1.83%