The Inference Report

September 28, 2026

The trending set reveals a decisive split between two developer priorities: agent infrastructure and local-first alternatives to cloud services. Paperclip dominates not because it's novel but because it solves a concrete problem at scale, managing multiple agents in production workflows. Hindsight, openrig, and the discovery repo shodh-memory all attack the same bottleneck: agents need memory that persists, learns, and doesn't require constant API calls. These aren't frameworks looking for problems. They're responses to the fact that agent systems are now operational tools, not experiments, and they leak money and latency through stateless designs.

The second pattern is more interesting because it's ideological. VoiceStudio, PipePipe, hwdsl2's self-hosted stack, and genoffice share a common thesis: users should own their compute. These repos aren't trying to be better than their commercial equivalents, they're trying to be free and local. VoiceStudio clones ElevenLabs' feature set but runs offline in 646 languages. Genoffice lets you generate .docx and .xlsx files without touching a cloud service. The discovery repos, label-studio, OpenVINO, Peekaboo, extend this further by providing the infrastructure layer: annotation tools that don't phone home, inference optimization that runs on modest hardware, screenshot capture for agents that don't require cloud vision APIs. The traction here signals that developers are tired of dependency chains that end in someone else's servers. Univer and dream-num's approach, building a runtime that handles spreadsheets, documents, and slides together, suggests the next frontier is bundling these local-first tools into coherent application suites rather than leaving users to stitch together twenty single-purpose binaries.

Jack Ridley

Trending
Daily discovery
verl-project/verl-omniReinforcement Learning
1127 ★

RL training framework for diffusion and omni-modality models

xuyang-liu16/Awesome-Token-level-Model-CompressionModel Compression
203 ★

📚 Collection of token-level model compression resources.

varun29ankuS/shodh-memoryEdge AI
295 ★

Cognitive brain for Claude, AI agents & edge devices — learns with use, runs offline, single binary. Neuroscience-grounded 3-tier architecture with Hebbian learning.

HumanSignal/label-studioDeep Learning
28360 ★

Label Studio is a multi-type data labeling and annotation tool with standardized output format

deepset-ai/haystack-core-integrationsNLP
205 ★

Additional packages (components, document stores and the likes) to extend the capabilities of Haystack

openclaw/PeekabooMCP
5218 ★

Peekaboo is a macOS CLI & optional MCP server that enables AI agents to capture screenshots of applications, or the entire system, with optional visual question answering through local or remote AI models.

openvinotoolkit/openvinoGenerative AI
10927 ★

OpenVINO™ is an open source toolkit for optimizing and deploying AI inference

PennyLaneAI/pennylaneNeural Network
3478 ★

PennyLane is an open-source quantum software platform for quantum computing, quantum machine learning, and quantum chemistry. Create meaningful quantum algorithms, from inspiration to implementation.

hwdsl2/self-hosted-ai-stackText-to-Speech
158 ★

Deploy a complete self-hosted AI stack with Docker Compose: Ollama, LiteLLM, AnythingLLM, Whisper, WhisperLive, Kokoro, Embeddings, Docling and MCP Gateway. Local-first, private by default, with lightweight stacks, optional HTTPS and NVIDIA CUDA acceleration. Multi-arch: amd64, arm64.

genspark-ai/genofficeAI Agents
8034 ★

Free, open-source AI Office suite: Docs, Sheets, Slides, PDF, Markdown and HTML editors with a built-in AI agent, plus a `genoffice` CLI and agent skill so Claude Code, Codex and Cursor can create and edit real .docx/.xlsx/.pptx files locally. Bring your own key. macOS, Windows & Linux.