GitSwarm: Decentralized Compounding Inference
GitSwarm turns inference-time work into a persistent, branchable body of reusable contributions that later agents can build on.
Key takeaway
GitSwarm replaces disposable agent attempts with asynchronous workers that commit drafts, tests, experiments and failed findings to a shared Git repository. Each commit records its starting state and additional semantic dependencies through informed_by. In the paper’s 50-task ProgramBench subset, GPT-5.5-High Codex workers score 79.39% versus 65.12% for a repeatedly continued single-agent baseline at a comparable budget. The authors also report all 30 IMOProofBench-Advanced proofs solved in one GPT-5.5-High run. The reuse statistics are evidence of recorded and observed reuse, not a causal proof that every dependency improved the final score.
Updated on Oct 31, 2026
01
Abstract
02
Problem
Why ordinary agent workflows lose useful computation
An agent may spend minutes reconstructing a codebase, testing a hypothesis or finding why an implementation fails. If its context ends and the result is not preserved in a structured form, the next agent repeats the same exploration. A shared chat transcript can retain text but often mixes hypotheses, evidence, code, decisions and stale context. A summary compresses information but can erase alternatives and provenance. GitSwarm treats the repository as structured memory: artifacts remain inspectable, competing lines of work remain separate, and dependencies are recorded so future workers can discover how a result was obtained.
03
Background
How GitSwarm differs from common multi-agent frameworks
Role-based systems such as MetaGPT and AutoGen commonly structure collaboration through assigned roles, message passing or an orchestrator. Independent best-of-N sampling explores candidates but typically discards non-selected work. Long single-agent trajectories preserve work inside one context but face context limits and can lose structured provenance. Summary-based memory compresses prior work but may flatten alternatives and omit exact artifacts. GitSwarm's differentiator is a persistent branchable artifact store with explicit cross-branch semantic dependencies and worker-selected next actions. It complements orchestration frameworks rather than making them obsolete: a production system could use an orchestrator for policy or routing while adopting Git-style durable memory for work products.
04
Methodology
GitSwarm workflow and compounding inference
GitSwarm coordinates asynchronous agents through inspect, scope, commit, verification, repair, and integration steps in a shared branchable repository.
User-provided research figure.
05
Architecture
GitSwarm architecture: workers, repository and harness
The system has three principal parts. A pool of homogeneous workers runs the same model and behavioral contract. A shared, branchable Git repository stores the task, code, experiments, findings and candidate solutions. An execution harness manages worker scheduling, isolated workspaces, publication validation, live activity visibility and final selection. The harness coordinates execution but does not assign intellectual roles such as researcher, tester or integrator. Each worker chooses what to do after inspecting the evolving repository. Specialization can emerge from the state of the work rather than from a centrally assigned role taxonomy.
06
Conclusion
Trending keywords and search strategy
The strongest research-aligned keyword cluster is around agent harnesses and persistent collaboration. Prioritise: compounding inference, multi-agent coding agents, agent harness, agent orchestration, persistent agent memory, shared memory for AI agents, asynchronous multi-agent systems, long-horizon agents, inference-time scaling, test-time compute, autonomous research agents, agentic software engineering, Git-based memory, branchable memory, semantic dependencies, multi-agent collaboration, coding agent swarm, program reconstruction, mathematical reasoning agents, negative-result reuse and artifact provenance. October 2026 research roundups show sustained attention to agent harnesses, long-horizon agents, coding-agent workflows and persistent work across sessions. These are topical trend signals from research curation, not measured search volume or a guarantee of ranking.
Practical lessons for AI engineers
The practical lesson is to preserve work products, not just conversation history. Make every agent episode produce a small, reviewable artifact: a code change, test, experiment, finding or explicit negative result. Track where it started and what it relied on. Keep branches independent until integration is justified. Make work visible while it is in flight to reduce duplication. Evaluate the final result separately from the accumulation process. Measure how much prior work is reused, how much repository ancestry reaches the selected solution, and how quickly costs grow as memory expands. For long-running agents, durable provenance and reproducible artifacts may matter as much as clever prompting.
Conclusion: from disposable attempts to cumulative work
GitSwarm reframes inference-time scaling as an information-retention and reuse problem. Its workers do not simply exchange messages; they contribute durable artifacts to a shared, branchable computation graph. The results are promising across program reconstruction, mathematical proofs and small-scale autonomous architecture research. The strongest evidence is not only the headline benchmark gap, but the measured reuse of earlier contributions and the recovery of failed ideas. Important questions remain about causal attribution, memory growth, compute efficiency, correctness and security. The paper's broader insight is compelling: an agent system should be evaluated not only by what one episode produces, but by how much useful capability the entire process accumulates.
07
References
Source trail
Primary papers, implementation pages, and external source records used to ground this explainer.
GitSwarm: Decentralized Compounding Inference
arXiv:2610.04862 (2026)
Primary paper defining compounding inference and the GitSwarm architecture.
ProgramBench: Can Language Models Rebuild Programs From Scratch?
arXiv:2605.03546 (2026)
Benchmark used for the program reconstruction evaluation.
Towards Robust Mathematical Reasoning
EMNLP 2025
IMO-Bench and IMO-ProofBench benchmark context.
AutoGen: Enabling Next-Gen LLM Applications via Multi-Agent Conversation
arXiv:2308.08155 (2023)
A contrasting message-oriented multi-agent framework.
MetaGPT: Meta Programming for A Multi-Agent Collaborative Framework
arXiv:2308.00352 (2023)
Role-based multi-agent collaboration as related work.
01Original research paper on arXiv02Authors’ project page with interactive figures and paper resources03ProgramBench benchmark paper04IMOProofBench: Towards Robust Mathematical Reasoning05AutoGen: Enabling Next-Gen LLM Applications via Multi-Agent Conversation06MetaGPT: Meta Programming for A Multi-Agent Collaborative Framework07DAIR.AI weekly AI papers issue, October 19–25 202608October 2026 AI research trends and agent harness coverageContinue reading
Related research
LongHarness
LongHarness helps agents reason over 100M-token document collections by keeping evidence and conclusions as explicit, revisable states that guide one another.
AI AgentsGenerative Agents
An agent architecture combining memory, retrieval, reflection, and planning to simulate believable long-horizon behavior.
AI AgentsAgentic Reasoning
A tool-using agent framework that extends LLM reasoning with web search, coding, and structured reasoning memory for deep research tasks.