Multi‐Agent Reinforcement Learning Framework for Optimizing Smart Cities as System of Systems

ABSTRACT This paper presents a novel framework for optimizing smart cities as System of Systems (SoS) by integrating Multi‐Agent Reinforcement Learning (MARL) with traditional systems engineering methodologies. Constituent systems–modeled as agents across domains such as transportation, energy, public safety, and communication, operate autonomously under diverse control modes (e.g., Acknowledged, Directed) while aligning with overarching SoS objectives. The proposed framework leverages decentralized policy learning and augmented reward mechanisms to improve coordination, adaptability, and system‐wide efficiency. Simulation results demonstrate a 14.3% increase in system efficiency, a 12.5% improvement in adaptability, and a 25.0% enhancement in coordination effectiveness. These findings underscore the potential of AI‐driven decision‐making to manage emergent behavior and complexity in dynamic, large‐scale urban environments.