Load Frequency Control of Power Systems Based on Deep Reinforcement Learning with Leader–Follower Consensus Control for State of Charge

With the extensive integration of renewable energy sources (RESs), power systems face challenges in load frequency control (LFC) due to RES intermittency. While energy storage systems (ESSs) aid frequency regulation, existing strategies are limited—single-type ESSs fail in multi-ESS scenarios, and hybrid ESSs lack state-of-charge (SoC) consistency control. This paper proposes an LFC framework combining energy storage aggregators (ESAs), leader–follower finite-time consensus control, and DDPG-RNN (Deep Deterministic Policy Gradient with Recurrent Neural Networks). ESAs aggregate small distributed ESSs for scalable regulation; consensus control ensures finite-time ESS power tracking and SoC balancing; and DDPG-RNN adaptively tunes control gains to handle RES fluctuations and load changes. Simulations on a high-RES power system with hybrid ESSs (SCES, LABES, VRFBES, LIPBES) show that the framework outperforms traditional proportional–integral–derivative (PID) control and basic leader–follower control: it reduces frequency deviation peaks, shortens recovery time, achieves SoC synchronization, and alleviates conventional generator power fluctuations.