Optimal Scheduling of Integrated Energy System Based on Flexibility Rule-Embedded TD3

The high penetration of renewable energy has exposed integrated energy systems (IES) to stronger source-load uncertainties. Traditional scheduling methods that primarily pursue economic optimality often fail to account for system regulation margins, which may lead to excessive charging and discharging of energy storage systems, frequent fluctuations in unit output, and insufficient supply–demand matching capability under uncertain operating scenarios. To address these issues, this paper proposes a Flex-TD3 optimal scheduling method for IESs with embedded flexibility rules. First, a regional IES model incorporating photovoltaic generation, wind power, micro-gas turbines, gas boilers, electric chillers, waste heat recovery units, heat exchangers, and battery energy storage systems is established to describe the coupling relationships among electricity, heat, cooling, and gas flows, as well as the operational constraints of key devices. Second, active regulation flexibility indicators are constructed from the perspectives of system upward regulation capability, downward regulation capability, energy storage state health, and electro-thermal decoupling regulation margin. A comprehensive flexibility score is then formulated to characterize the system’s capability to cope with renewable energy fluctuations and load disturbances under the current operating state. Third, the flexibility indicators are embedded into the state space and reward function of the Twin Delayed Deep Deterministic Policy Gradient (TD3) algorithm, and a rule-based physical feasibility mapping mechanism is introduced to modify the raw scheduling actions generated by the agent according to device operational constraints, thereby enhancing the physical consistency and operational safety of the scheduling strategy. Case study results show that, compared with traditional optimal scheduling methods, the proposed method achieves better overall performance in terms of training convergence speed, operational economy, and scheduling stability. It can effectively reduce system operating costs, improve renewable energy accommodation capability, and decrease renewable energy curtailment, supply shortages, and constraint violations. Under uncertain scenarios involving renewable energy prediction errors, load disturbances, and high renewable energy penetration, the proposed method still maintains favorable scheduling performance, demonstrating its effectiveness and robustness.