Abstract:Recently, grid-integrated wind power and photovoltaics have experienced rapid growth. However, their uncertainty increases the difficulty of grid scheduling and operation. Short-term power generation decisions made by conventional scheduling methods, which are based on the output forecast information of wind and solar power often impact the power benefit owing to forecast errors during the actual operation. This study explores the application of deep reinforcement learning methods for short-term optimal scheduling of hydro-wind-solar multi-energy power system, considering forecast uncertainty. First, with the objective of maximizing power generation benefit from the multi-energy complementary system, the Deep Q Network (DQN) method in deep reinforcement learning is employed to construct the model framework of the short-term optimal scheduling of hydro-wind-solar multi-energy power system (collectively referred to as DQN model later). Thereafter, the impact of each learning parameter in the DQN model on performances is analyzed, and the model parameters are reasonably configured. Furthermore, the DQN model is driven by wind and solar power output forecast data to develop short-term power generation decisions. Finally, the actual wind and solar power output is used as input to implement short-term decisions, whereas the dynamic programming (DP) method is used to build the model as a comparison to evaluate the power benefit and computational efficiency of the DQN model. The multi-energy complementary system of hydro, wind, and solar power of the Jinping-1 Hydropower Station in the Yalong river basin is used as an example for the study. In the flood season, compared with the DP model and the historical actual operation process, the total power generation benefits obtained from the DQN model's implementation of short-term decision-making increases by 6.18% and 1.38%, respectively. In the dry season, the total power generation benefits obtained from the DQN model's implementation of short-term decision-making increases by 2.26% and 19.00% respectively compared with the DP model and the historical actual operation process. Additionally, the DQN model can significantly improve the decision-making efficiency. The DP model requires minutes or hours of computation time; the DQN model consumes less than 1s to compute, which is conducive to efficient decision making of the complementary system.

F-DQN: an optimized DQN for decision-making of generator start-up sequence after blackout

Black Start With Dfig-Based Wind Turbines Using Improved Virtual Synchronous Control

Power System Black-Start Decision Making Based on Back-Propagation Neural Network and Genetic Algorithm

A Bayesian Deep Reinforcement Learning-Based Resilient Control for Multi-Energy Micro-Gird

A New Solution to Generators Start-Up Sequence During Power System Restoration

Research on the multi-timescale optimal voltage control method for distribution network based on a DQN-DDPG algorithm

Greedy Algorithm For Generator Start-Up Sequence Optimization In Power System Restoration Considering Transmission Path

Adaptive Power System Emergency Control using Deep Reinforcement Learning

DDPG-based Reactive Power Optimization Strategy for Active Distribution Network

Deep Reinforcement Learning for Load Shedding Against Short-Term Voltage Instability in Large Power Systems

Research on short-term optimal scheduling of hydro-wind-solar multi-energy power system based on deep reinforcement learning

Evaluation of Black-Start Schemes Employing Entropy Weight-Based Decision-Making Theory

Resilience-based post disaster recovery optimization for infrastructure system via Deep Reinforcement Learning

Optimizing Load Scheduling in Power Grids Using Reinforcement Learning and Markov Decision Processes

A Deep Reinforcement Learning Based Approach for Optimal Active Power Dispatch

The Optimal Dispatching Strategy of Cogeneration Based on Deep Q-Network (DQN) Algorithm

A Safe DRL Method for Fast Solution of Real-Time Optimal Power Flow

A Distributed Generation-Based Local Self-Recovery Scheme for Distribution Network at Post-Blackout Early Stage of Power Grid Restoration

Safe deep reinforcement learning for real-time AC optimal power flow: A near-optimal solution

Deep learning-based post-disaster energy management and faster network reconfiguration method for improvement of restoration time

An Improved Deep Reinforcement Learning Method for Dispatch Optimization Strategy of Modern Power Systems