The Inference Report

March 21, 2026

Meanwhile, as federal courts weigh whether Anthropic poses a national security threat and the Trump administration releases a framework designed to preempt state AI regulations, the real battle is shifting beneath the political theater toward control of infrastructure and the platforms through which work flows. The government's case against Anthropic rests on technical misunderstandings, according to sworn declarations filed Friday, yet the administration's National Policy Framework emphasizes lighter-touch rules for companies while attempting to centralize authority over AI policy at the federal level. Big Tech is fracturing over these attacks, with former Trump allies offering unprecedented criticism even as the administration tries to block state-level laws. This is not philosophical disagreement about safety. It is a power struggle over who writes the rules: the executive branch, states, or the companies themselves.

Beneath the regulatory rupture, power has become the bottleneck constraining the entire enterprise. Nvidia's CEO Jensen Huang projects one trillion dollars in AI chip sales through 2027, yet energy consumption is now the north star metric alongside accuracy and engagement as engineers discover that rolling out new data centers depends on power availability, not model capability. Microsoft rolled back Copilot bloat on Windows after user and developer resistance to forced integration. OpenAI is folding ChatGPT, Codex, and its browser Atlas into a single desktop superapp, signaling a shift toward enterprise infrastructure and developer tools away from the consumer market that made it a household name. These are admissions that the consumer AI wave has peaked and the real money is in developer platforms and enterprise lock-in.

Distribution control is now the prize. WordPress.com lets AI agents write and publish posts directly. Google embedded AI into Stitch, enabling developers to describe interfaces in natural language. Amazon is building a smartphone called Transformer to integrate shopping, streaming, and voice services through Alexa. LinkedIn banned an AI agent that had conquered the platform. Each move lowers friction for adoption while raising switching costs and centralizing control through the platform. PwC told staff they must embrace AI or face replacement. Google told researchers to stop submitting AI-generated bug reports to its open-source program due to hallucinations and low quality. AI adoption is no longer optional, quality control is breaking down at scale, and the winners will be whoever owns the platform through which work flows.

The technical evidence confirms this shift. Benchmark performance has plateaued at the top tier, with Claude Code holding 52.9% on SWE-rebench and the next three positions separated by less than 1.2 percentage points, signaling that incremental gains in raw capability now demand substantial effort. On GitHub, the dominant pattern is developers moving past building individual models toward building systems that orchestrate them: Claude HUD, Open-SWE, and Superpowers all solve the same problem of making autonomous agents predictable enough to trust in production. The repos gaining traction are those that make the infrastructure layers reliable: specialized data handling for AI pipelines, vector storage, dataflow definition, and domain-specific scaffolding. The boring parts of AI systems, not raw capability, are what developers are actively building on.

Grant Calloway

AI LabsAll labs
From the WireAll feeds
Research Papers — FocusedAll papers
Compass: Continuously Aligning Social Media Feeds via In-Situ Reflections cs.HC

Social media recommendation feeds often optimize for users' immediate impulses rather than preferences they would hold after deeper reflection. Some systems address this misalignment by incorporating users' explicit preferences via a configuration page or in-feed controls instead of just behavioral signals. However, users typically have evolving preferences, and their stated preferences and behavior naturally diverge, necessitating continuous reflection and feed realignment. But existing strategies require the user to take initiative and are often effortful; as a result, in practice they are rarely invoked. We present Compass, a system that aligns a user's feed with their reflective preferences by helping users reflect on and articulate their preferences given their behavior. To enable continuous reflection during everyday browsing, Compass surfaces in-situ reflections via lightweight notifications, while feed alignment is achieved by periodically simulating behavioral signals and directly manipulating feed content. We embedded Compass within YouTube Shorts and compared it against a baseline without continuous support through a 10-day field study (N=15). We found that Compass promoted more reflective and purposeful feed consumption, iterative preference adjustment, and stronger feed alignment, without sacrificing the casual nature of feed browsing.

ArtAnno: Annotating Implicit Semantics in Artworks through LLM Agent-Driven Bidirectional Human-AI Augmentation cs.HC

High-quality annotation of artworks is essential for computational art research, yet extracting implicit semantics remains challenging due to the reliance on culturally grounded meanings and deep contextual knowledge behind the images. Current AI-assisted annotation tools often lack assistance or rely on one-way workflows where experts have to perform extra manual calibrations to improve AI models, resulting in limited efficiency. To address this, we propose Bidirectional Human-AI Augmentation(BiHAA), a closed-loop framework in which skills and domain knowledge base evolve through real-time interaction and bidirectional HAI augmentation. Informed by a formative study with 20 artwork annotators from different backgrounds, we implement this framework in ArtAnno, an artwork annotation system driven by a multi-agent architecture. The system includes a Proactive Agentic Support Module, where AI augments humans through semantic mining and label suggestion, and an Interaction-Driven Evolution Module, where human expertise continuously enhances the AI through distilling annotation trajectories into reusable experience. Evaluation through a user study and two case studies demonstrates that our framework and system improve annotation efficiency, enable knowledge accumulation, and reduce the effort of information seeking and verification for annotators with limited domain expertise. We conclude by discussing broader implications and future directions.

Chat Debugging: An Exploratory Study of Human-AI Collaboration to Debug Analog Circuits cs.HC

This research paper describes an exploratory study on the effectiveness of Chat Debugging: troubleshooting malfunctioning analog circuits on breadboards and printed circuit boards (PCB) by undergraduates through conversations with public-domain large language models (LLMs). Through thematic analysis of students' voluntarily shared chat logs when debugging pre-determined buggy circuits under exam and time pressure, we discovered multimodal usage patterns by students and considerable domain knowledge and sensible debugging suggestions offered by off-the-shelf LLMs. Meanwhile, we also identified major gaps in LLM technologies and students' skills during human-AI collaborative debugging, such as LLMs' limitations in 2D/3D image-based reasoning, unjustified tone of confidence, and students' deficits in fundamental concepts and critical thinking.

From Wearable Data to Personalized and Actionable Health Insights cs.HC

Commercial wearable devices continuously capture rich physiological data (e.g., heart rate, respiration), opening new possibilities for monitoring health conditions, notably around stress. Despite their promise, turning raw wearable physiological data streams into visualizations that surface stress-related insights in daily activities, and that ultimately foster reflection, awareness, and better stress management, remains a significant challenge. The data are noisy and context-dependent: the same spike in heart rate can come from sprinting, a tense presentation, or laughing with friends. To address these challenges, we propose a framework that combines user annotations with wearable data to support better stress management. We introduce a web framework offering interactive visualizations that layer daily activities, stress events, and interventions onto raw physiological streams, enabling users to reflect and identify trends. In a four-week pilot with seven university graduate and undergraduate student participants who logged 269 events, our tool revealed patterns between different types of interventions and stress: social interaction reduced average heart rate by 4.35 to 5.0 beats per minute, deliberate rest reduced average Garmin stress scores by 10.03 to 13.83 points, and mindfulness activities decreased average HRV by 6.61 to 13.22 milliseconds.

Reassessing the Feasibility of PPG-Based Non-Invasive Blood Glucose Level Estimation cs.HC

Non-invasive blood glucose level (BGL) estimation from photoplethysmography (PPG) holds great promise for wearable health monitoring, but results across studies are hard to compare due to inconsistent datasets, data leakage, and non-standardized evaluation metrics. We present the first reproducible, extensible evaluation pipeline and use it to reassess five representative PPG-based BGL methods on published datasets under three increasingly strict data-split protocols: random window-level, participant-aware, and leave-some-participants-out (LSPO). Models appeared competitive under random splitting but collapsed under participant-aware and LSPO evaluation, with nearly all yielding near-zero or negative R$^2$ values comparable to a mean-prediction baseline. Critically, across every model and split, over 90% of predictions fell within clinically acceptable zones (Clarke Error Grid A+B), including the baseline. This reveals a fundamental disconnect: clinical zone metrics systematically conceal model failure in this domain. Our findings demonstrate that random train-test splits substantially overestimate the generalization of PPG-based BGL models due to sample-level data leakage, and that robust ML evaluation must precede clinical validation to meaningfully assess real-world utility.

From Information to Delegation: Mapping Human-AI Financial Decision Making cs.HC

As AI increasingly participates in human decision making, understanding how decision-making authority is distributed between humans and AI has become a fundamental behavioural question. We introduce a behavioural measurement framework combining intent and delegated decision authority to quantify what consumers seek from AI and how much decision-making authority they assign to it. Applied to 1.5 million real-world ChatGPT and Gemini interactions from 6,304 users in the United States and India, we find that financial services are already a substantial AI use case. Consumers overwhelmingly use AI to retrieve information and shape financial judgement, while delegation of financial execution remains rare. By shifting attention from conversation topics to delegated decision authority, this work establishes a behavioural baseline for measuring the transition to increasingly agentic AI.

BenchmarksFull tables
Artificial AnalysisIntelligence Index

Composite score across coding, math, and reasoning

#ModelScoretok/s$/1M
1GPT-5.457.286$5.63
2Gemini 3.1 Pro Preview57.2117$4.50
3GPT-5.3 Codex5474$4.81
4Claude Opus 4.65354$10.00
5Claude Sonnet 4.651.770$6.00
SWE-rebench

Agentic coding on real-world software engineering tasks

#ModelScore
1Claude Code52.9%
2Junie52.1%
3Claude Opus 4.651.7%
4gpt-5.2-2025-12-11-xhigh51.7%
5gpt-5.2-2025-12-11-medium51.0%