Abstract:The growing renewable energy sources have posed significant challenges to traditional power scheduling. It is difficult for operators to obtain accurate day-ahead forecasts of renewable generation, thereby requiring the future scheduling system to make real-time scheduling decisions aligning with ultra-short-term forecasts. Restricted by the computation speed, traditional optimization-based methods can not solve this problem. Recent developments in reinforcement learning (RL) have demonstrated the potential to solve this challenge. However, the existing RL methods are inadequate in terms of constraint complexity, algorithm performance, and environment fidelity. We are the first to propose a systematic solution based on the state-of-the-art reinforcement learning algorithm and the real power grid environment. The proposed approach enables planning and finer time resolution adjustments of power generators, including unit commitment and economic dispatch, thus increasing the grid's ability to admit more renewable energy. The well-trained scheduling agent significantly reduces renewable curtailment and load shedding, which are issues arising from traditional scheduling's reliance on inaccurate day-ahead forecasts. High-frequency control decisions exploit the existing units' flexibility, reducing the power grid's dependence on hardware transformations and saving investment and operating costs, as demonstrated in experimental results. This research exhibits the potential of reinforcement learning in promoting low-carbon and intelligent power systems and represents a solid step toward sustainable electricity generation.

Physics-Informed Reinforcement Learning for Real-Time Optimal Power Flow with Renewable Energy Resources

Real-Time Optimal Power Flow Method Via Safe Deep Reinforcement Learning Based on Primal-Dual and Prior Knowledge Guidance

A Safe DRL Method for Fast Solution of Real-Time Optimal Power Flow

Real-time Sequential Security-Constrained Optimal Power Flow: A Hybrid Knowledge-Data-Driven Reinforcement Learning Approach

Deep Reinforcement Learning for Optimal Power Flow with Renewables Using Graph Information

A Data-driven Method for Fast AC Optimal Power Flow Solutions via Deep Reinforcement Learning

Safe deep reinforcement learning for real-time AC optimal power flow: A near-optimal solution

A Deep Reinforcement Learning Based Approach for Optimal Active Power Dispatch

Real-time scheduling of renewable power systems through planning-based reinforcement learning

Constrained Reinforcement Learning for Predictive Control in Real-Time Stochastic Dynamic Optimal Power Flow

Deep Reinforcement Learning Based Approach for Optimal Power Flow of Distribution Networks Embedded with Renewable Energy and Storage Devices

Data-Driven Nonparametric Probabilistic Optimal Power Flow: an Integrated Probabilistic Forecasting and Analysis Methodology

Real-time Autonomous Line Flow Control Using Proximal Policy Optimization

Nonparametric Probabilistic Optimal Power Flow

Optimal Power Flow in Highly Renewable Power System Based on Attention Neural Networks

Deep reinforcement learning based power system optimal carbon emission flow

A Physics-Informed Machine Learning for Electricity Markets: A NYISO Case Study

Real-time Power Scheduling Through Reinforcement Learning from Demonstrations

Optimal Power Flow in a highly renewable power system based on attention neural networks

Deep Reinforcement Learning Based Approach for Dynamic Optimal Power Flow in Active Distribution Network

Economic dispatch of industrial park considering uncertainty of renewable energy based on a deep reinforcement learning approach