A Deep Reinforcement Learning Framework for Cascade Reservoir Operations Under Runoff Uncertainty

Effective management of cascade reservoir systems is essential for balancing hydropower generation, flood control, and ecological sustainability, especially under increasingly uncertain runoff conditions driven by climate change. Traditional optimization methods, while widely used, often struggle with high dimensionality and fail to adequately address inflow variability. This study introduces a novel deep reinforcement learning (DRL) framework that tightly couples probabilistic runoff forecasting with adaptive reservoir scheduling. We integrate a Long Short-Term Memory (LSTM) neural network to model runoff uncertainty and generate probabilistic inflow forecasts, which are then embedded into a Proximal Policy Optimization (PPO) algorithm via Monte Carlo sampling. This unified forecast–optimize architecture allows for dynamic policy adjustment in response to stochastic hydrological conditions. A case study on China’s Xiluodu–Xiangjiaba cascade system demonstrates that the proposed LSTM-PPO framework achieves superior performance compared to traditional baselines, notably improving power output, storage utilization, and spillage reduction. The results highlight the method’s robustness and scalability, suggesting strong potential for supporting resilient water–energy nexus management under complex environmental uncertainty.