Research

GitSwarm: Decentralized Compounding Inference

GitSwarm turns inference-time work into a persistent, branchable body of reusable contributions that later agents can build on.

Vedant Shah, Ankur Samanta, Paras Dahal, Mikhail Plekhanov, Carole-Jean Wu, Scott Yih, Remi Munos, Rob Fergus, Jakob Foerster, Ruslan Salakhutdinov, Sanjeev Arora, Jason Weston, Aaron Courville, Anirudh GoyalOct 4, 2026arXiv preprint arXiv:2610.0486216 min readMeta Superintelligence Labs; Mila – Québec AI Institute; Université de Montréal; Columbia University; Carnegie Mellon University; Princeton University
IMPORTANTAI AgentsAdvanced

Key takeaway

GitSwarm replaces disposable agent attempts with asynchronous workers that commit drafts, tests, experiments and failed findings to a shared Git repository. Each commit records its starting state and additional semantic dependencies through informed_by. In the paper’s 50-task ProgramBench subset, GPT-5.5-High Codex workers score 79.39% versus 65.12% for a repeatedly continued single-agent baseline at a comparable budget. The authors also report all 30 IMOProofBench-Advanced proofs solved in one GPT-5.5-High run. The reuse statistics are evidence of recorded and observed reuse, not a causal proof that every dependency improved the final score.

Updated on Oct 31, 2026

01

Abstract

02

Problem

Why ordinary agent workflows lose useful computation

An agent may spend minutes reconstructing a codebase, testing a hypothesis or finding why an implementation fails. If its context ends and the result is not preserved in a structured form, the next agent repeats the same exploration. A shared chat transcript can retain text but often mixes hypotheses, evidence, code, decisions and stale context. A summary compresses information but can erase alternatives and provenance. GitSwarm treats the repository as structured memory: artifacts remain inspectable, competing lines of work remain separate, and dependencies are recorded so future workers can discover how a result was obtained.

03

Background

How GitSwarm differs from common multi-agent frameworks

Role-based systems such as MetaGPT and AutoGen commonly structure collaboration through assigned roles, message passing or an orchestrator. Independent best-of-N sampling explores candidates but typically discards non-selected work. Long single-agent trajectories preserve work inside one context but face context limits and can lose structured provenance. Summary-based memory compresses prior work but may flatten alternatives and omit exact artifacts. GitSwarm's differentiator is a persistent branchable artifact store with explicit cross-branch semantic dependencies and worker-selected next actions. It complements orchestration frameworks rather than making them obsolete: a production system could use an orchestrator for policy or routing while adopting Git-style durable memory for work products.

04

Methodology

Figure 1

GitSwarm workflow and compounding inference

GitSwarm coordinates asynchronous agents through inspect, scope, commit, verification, repair, and integration steps in a shared branchable repository.

User-provided research figure.

05

Architecture

GitSwarm architecture: workers, repository and harness

The system has three principal parts. A pool of homogeneous workers runs the same model and behavioral contract. A shared, branchable Git repository stores the task, code, experiments, findings and candidate solutions. An execution harness manages worker scheduling, isolated workspaces, publication validation, live activity visibility and final selection. The harness coordinates execution but does not assign intellectual roles such as researcher, tester or integrator. Each worker chooses what to do after inspecting the evolving repository. Specialization can emerge from the state of the work rather than from a centrally assigned role taxonomy.

06

Conclusion

Trending keywords and search strategy

The strongest research-aligned keyword cluster is around agent harnesses and persistent collaboration. Prioritise: compounding inference, multi-agent coding agents, agent harness, agent orchestration, persistent agent memory, shared memory for AI agents, asynchronous multi-agent systems, long-horizon agents, inference-time scaling, test-time compute, autonomous research agents, agentic software engineering, Git-based memory, branchable memory, semantic dependencies, multi-agent collaboration, coding agent swarm, program reconstruction, mathematical reasoning agents, negative-result reuse and artifact provenance. October 2026 research roundups show sustained attention to agent harnesses, long-horizon agents, coding-agent workflows and persistent work across sessions. These are topical trend signals from research curation, not measured search volume or a guarantee of ranking.

Practical lessons for AI engineers

The practical lesson is to preserve work products, not just conversation history. Make every agent episode produce a small, reviewable artifact: a code change, test, experiment, finding or explicit negative result. Track where it started and what it relied on. Keep branches independent until integration is justified. Make work visible while it is in flight to reduce duplication. Evaluate the final result separately from the accumulation process. Measure how much prior work is reused, how much repository ancestry reaches the selected solution, and how quickly costs grow as memory expands. For long-running agents, durable provenance and reproducible artifacts may matter as much as clever prompting.

Conclusion: from disposable attempts to cumulative work

GitSwarm reframes inference-time scaling as an information-retention and reuse problem. Its workers do not simply exchange messages; they contribute durable artifacts to a shared, branchable computation graph. The results are promising across program reconstruction, mathematical proofs and small-scale autonomous architecture research. The strongest evidence is not only the headline benchmark gap, but the measured reuse of earlier contributions and the recovery of failed ideas. Important questions remain about causal attribution, memory growth, compute efficiency, correctness and security. The paper's broader insight is compelling: an agent system should be evaluated not only by what one episode produces, but by how much useful capability the entire process accumulates.

Continue reading

Related research

Browse all research
Machinoai Logo
Machinoai

Your edge in the AI era. Deep dives into machine learning concepts, paper explainers, verified industry jobs, and developer tools.

© 2026 Machinoai. All rights reserved.