Answers are grounded in this paper and cite their sources.
Multi‐agent systems (MAS)—a uniquely important subset of the wider field commonly called “Agentic AI”—enable complex work processes involving distributed networks of multiple AIs, people, and technology tools. However, they also carry big risks. Root causes of catastrophic safety failures in multi‐agent collaboration (as in human collaboration) can be classed into three overlapping categories: 1. Deliberative —deviating from shared MAS commitments to fulfill explicitly expressed joint intentions; 2. Performative —inability to coordinate well or to adapt to changing circumstances; and 3. Infrastructural —safety, reliability, and trust in the operating environment. In the spirit of the international Multi‐Agent System Safety and Teamwork (MASST) initiative (Bradshaw et al., 2026), our multi‐disciplinary research team seeks to tackle the root causes of these three challenges through development, experimentation, and deployment of an integrated multi‐layered safety pipeline, enabling “safety in numbers” as increasingly powerful multi‐agent systems are deployed. Although this proposal is merely an initial sketch, it is our hope that sharing these ideas will inspire others to contribute to the discussion as we continue moving forward. We look forward not only to exciting discoveries within laboratory settings while also being committed to improving safe rollout of large‐scale MAS into the world to perform work in high‐consequence applications.
No takes yet. Share an insight, caveat, or question.
Bradshaw et al. (2026) studied this question.
Synapse has enriched 10 related papers. Consider them for comparative context: