Abstract:Recently, grid-integrated wind power and photovoltaics have experienced rapid growth. However, their uncertainty increases the difficulty of grid scheduling and operation. Short-term power generation decisions made by conventional scheduling methods, which are based on the output forecast information of wind and solar power often impact the power benefit owing to forecast errors during the actual operation. This study explores the application of deep reinforcement learning methods for short-term optimal scheduling of hydro-wind-solar multi-energy power system, considering forecast uncertainty. First, with the objective of maximizing power generation benefit from the multi-energy complementary system, the Deep Q Network (DQN) method in deep reinforcement learning is employed to construct the model framework of the short-term optimal scheduling of hydro-wind-solar multi-energy power system (collectively referred to as DQN model later). Thereafter, the impact of each learning parameter in the DQN model on performances is analyzed, and the model parameters are reasonably configured. Furthermore, the DQN model is driven by wind and solar power output forecast data to develop short-term power generation decisions. Finally, the actual wind and solar power output is used as input to implement short-term decisions, whereas the dynamic programming (DP) method is used to build the model as a comparison to evaluate the power benefit and computational efficiency of the DQN model. The multi-energy complementary system of hydro, wind, and solar power of the Jinping-1 Hydropower Station in the Yalong river basin is used as an example for the study. In the flood season, compared with the DP model and the historical actual operation process, the total power generation benefits obtained from the DQN model's implementation of short-term decision-making increases by 6.18% and 1.38%, respectively. In the dry season, the total power generation benefits obtained from the DQN model's implementation of short-term decision-making increases by 2.26% and 19.00% respectively compared with the DP model and the historical actual operation process. Additionally, the DQN model can significantly improve the decision-making efficiency. The DP model requires minutes or hours of computation time; the DQN model consumes less than 1s to compute, which is conducive to efficient decision making of the complementary system.

Fast Coordinated Predictive Control for Renewable Energy Integrated Cascade Hydropower System Based on Quantum Neural Network

A Bayesian Deep Reinforcement Learning-Based Resilient Control for Multi-Energy Micro-Gird

Distributed Real-Time Multi-Objective Control of a Virtual Power Plant in DC Distribution Systems

Surrogate Model-Based Multi-timescale Stochastic Control of Islanded Cascaded Hydro-Solar System Considering Non-Gaussian Uncertainty

Predictor-Based Neural Network Finite-Set Predictive Control for Modular Multilevel Converter

Adaptive NN Control of FESS with Constrained Full Order Error States

Resilience-Based Coordinated Scheduling of Cascaded Hydro Power with Sequential Heavy Precipitation

Data-driven methods for situation awareness and operational adjustment of sustainable energy integration into power systems

Stochastic Receding Horizon Control of Active Distribution Networks with Distributed Renewables

A Predictive Power Ramp Rate Control Scheme with an Updating Gaussian Prediction Confidence Estimator for PV Systems

Two-Time-Scale Coordinated Energy Management for Medium-Voltage Dc Systems

Neural Predictor-Based Dynamic Surface Predictive Control for Power Converters

Smart energy management: process structure-based hybrid neural networks for optimal scheduling and economic predictive control in integrated systems

Neural network predictive control in renewable systems (HKT-PV) for delivered power smoothing

Multi-Time Scale Optimal Dispatch for the Wind Power Integrated System with Demand Response of Data Centers Based on Neural Network-Based Model Predictive Control

Ultra-short-term wind power probabilistic forecasting based on an evolutionary non-crossing multi-output quantile regression deep neural network

Research on short-term optimal scheduling of hydro-wind-solar multi-energy power system based on deep reinforcement learning

Advancing Hybrid Quantum Neural Network for Alternative Current Optimal Power Flow

Multi-time Scale Collaborative Optimal Dispatching for Regional Grid Integrated with Renewable Energy and Battery Energy Storage Based on GrowNet

Advanced AI and renewable energy sources for unified rotor angle stability control

Multi-time Scale Active and Reactive Power Coordinated Optimal Dispatch in Active Distribution Network Based on Model Predictive Control