Abstract:The growing renewable energy sources have posed significant challenges to traditional power scheduling. It is difficult for operators to obtain accurate day-ahead forecasts of renewable generation, thereby requiring the future scheduling system to make real-time scheduling decisions aligning with ultra-short-term forecasts. Restricted by the computation speed, traditional optimization-based methods can not solve this problem. Recent developments in reinforcement learning (RL) have demonstrated the potential to solve this challenge. However, the existing RL methods are inadequate in terms of constraint complexity, algorithm performance, and environment fidelity. We are the first to propose a systematic solution based on the state-of-the-art reinforcement learning algorithm and the real power grid environment. The proposed approach enables planning and finer time resolution adjustments of power generators, including unit commitment and economic dispatch, thus increasing the grid's ability to admit more renewable energy. The well-trained scheduling agent significantly reduces renewable curtailment and load shedding, which are issues arising from traditional scheduling's reliance on inaccurate day-ahead forecasts. High-frequency control decisions exploit the existing units' flexibility, reducing the power grid's dependence on hardware transformations and saving investment and operating costs, as demonstrated in experimental results. This research exhibits the potential of reinforcement learning in promoting low-carbon and intelligent power systems and represents a solid step toward sustainable electricity generation.

Reinforcement Learning and Stochastic Optimization with Deep Learning-Based Forecasting on Power Grid Scheduling

Multi-agent Deep Reinforcement Learning Algorithm for Distributed Economic Dispatch in Smart Grid.

Demand Forecasting and Resource Scheduling of Independent Energy Storage Market in Power Grid with Deep Learning

Optimizing Load Scheduling in Power Grids Using Reinforcement Learning and Markov Decision Processes

Reinforcement Learning Optimized Intelligent Electricity Dispatching System

Real-time scheduling of renewable power systems through planning-based reinforcement learning

Forecast-driven stochastic optimization scheduling of an energy management system for an isolated hydrogen microgrid

Data-Driven Online Energy Scheduling of a Microgrid Based on Deep Reinforcement Learning

An intelligent scheduling control method for smart grid based on deep learning

A Holistic Power Optimization Approach for Microgrid Control Based on Deep Reinforcement Learning

Optimal Operation Strategy for Distribution Grid with High Penetration Renewable Energy: a Novel Deep Reinforcement Learning Based Approach

A Novel Forecasting Based Scheduling Method for Household Energy Management System Based on Deep Reinforcement Learning

A Deep Reinforcement Learning Algorithm for the Power Order Optimization Allocation of AGC in Interconnected Power Grids

Robust Dynamic Economic Dispatch in Smart Grids Using an Intelligent Learning Technology

Load Forecasting-Based Learning System for Energy Management With Battery Degradation Estimation: A Deep Reinforcement Learning Approach

Reinforcement Learning Assisted Deep Learning for Probabilistic Charging Power Forecasting of EVCS

Optimal Scheduling of Isolated Microgrids Using Automated Reinforcement Learning-Based Multi-Period Forecasting

Distributed Deep Reinforcement Learning for Intelligent Load Scheduling in Residential Smart Grids

A Deep Reinforcement Learning Based Approach for Optimal Active Power Dispatch

Dynamic optimization of an integrated energy system with carbon capture and power-to-gas interconnection: A deep reinforcement learning-based scheduling strategy

A Stochastic Online Forecast-and-Optimize Framework for Real-Time Energy Dispatch in Virtual Power Plants under Uncertainty