Key points are not available for this paper at this time.
As Multi-Agent Reinforcement Learning (MARL) systems are increasingly deployed in safety-critical applications, understanding why agents make decisions and how they collectively achieve intelligent behavior becomes paramount. However, existing explainable AI (XAI) methods fail to address the unique challenges of multi-agent settings: attributing collective outcomes to individual agents, quantifying emergent behaviors, and accounting for complex agent interactions. We present MACIE (Multi-Agent Causal Intelligence Explainer), a principled framework that unifies structural causal models, interventional counterfactuals, and Shapley values to provide comprehensive explanations of multi-agent systems. MACIE addresses three fundamental questions: (1) What is each agent's causal contribution to collective outcomes? through interventional attribution scores; (2) Does the system exhibit emergent intelligence? via novel synergy metrics that distinguish collective effects from individual contributions; and (3) How can explanations be made actionable for stakeholders? through natural language generation that synthesizes causal insights into human-interpretable narratives. We evaluate MACIE across four diverse MARL scenarios spanning cooperative, competitive, and mixed-motive settings. Our results demonstrate that MACIE accurately attributes outcomes to individual agents (mean absolute attribution |ϕi| = 5.07, standard deviation < 0.05), successfully detects positive emergence in cooperative tasks (Synergy Index up to 0.461), and achieves remarkable computational efficiency (average 0.79 seconds per dataset on CPU-only hardware). Compared to existing attribution methods, MACIE uniquely combines causal rigor, emergence quantification, and multi-agent support while maintaining practical feasibility for realtime deployment. Our framework represents a significant advance toward interpretable, trustworthy, and accountable multi-agent AI systems.
Abraham Itzhak Weinberg (Thu,) studied this question.