Answers are grounded in this paper and cite their sources.
Large language models (LLMs) are growing increasingly powerful. Yet, fundamental constraints on the reasoning, memory, and performance of individual models has sparked recent interest in scaling abilities using LLM teams. With growing deployment of LLM teams at scale, there is a need for principled guidelines for when teams help, how many agents to use, and how structure impacts performance. Rather than building these teams through trial-and-error, we propose using distributed systems as a formal foundation for designing and evaluating LLM teams. Under this formal framework, we derive predictions about how task structure and team architecture should shape performance. Empirical evidence supports these predictions: LLM team scaling follows classical distributed computing laws based on the structure of a task, and centralized and decentralized architectures exhibit the asymmetric vulnerabilities predicted by distributed systems theory. These results establish distributed computing as a generative framework that yields testable, quantitative predictions about LLM team behavior and informs the construction of more efficient and capable teams.
No takes yet. Share an insight, caveat, or question.
Mieczkowski et al. (2026) studied this question.
Synapse has enriched 10 related papers. Consider them for comparative context: