Automatic Generation Control Based on Multiple Neural Networks With Actor-Critic Strategy

As the conventional automatic generation control (AGC) is inadequate to deal with the strong random disturbance issues induced by the ever-increasing penetration of renewable energy to the power grids, this article proposes a deep-reinforcement-learning-based three-network double-delay actor-critic (TDAC) control strategy for AGC to handle the above problem, which is mainly developed by multiple neural networks to fit the system action strategies and evaluate the value. The proposed strategy can increase the exploration efficiency and the quality of AGC and improve the system control performance using the modified actor-critic (AC) method with incentive heuristic mechanism, while a novel iterative way of the value function is also used to reduce the bias of optimization effectively for achieving optimal coordinated control of the power grid. The simulations are provided in the work to show the control performance of the strategy. Compared with other smart methods, the simulation study demonstrates that TDAC has excellent exploratory stability and learning ability. Meanwhile, it also can improve the dynamic performance of the power system and achieve the regional optimal coordinated control.