Abstract:Recently, grid-integrated wind power and photovoltaics have experienced rapid growth. However, their uncertainty increases the difficulty of grid scheduling and operation. Short-term power generation decisions made by conventional scheduling methods, which are based on the output forecast information of wind and solar power often impact the power benefit owing to forecast errors during the actual operation. This study explores the application of deep reinforcement learning methods for short-term optimal scheduling of hydro-wind-solar multi-energy power system, considering forecast uncertainty. First, with the objective of maximizing power generation benefit from the multi-energy complementary system, the Deep Q Network (DQN) method in deep reinforcement learning is employed to construct the model framework of the short-term optimal scheduling of hydro-wind-solar multi-energy power system (collectively referred to as DQN model later). Thereafter, the impact of each learning parameter in the DQN model on performances is analyzed, and the model parameters are reasonably configured. Furthermore, the DQN model is driven by wind and solar power output forecast data to develop short-term power generation decisions. Finally, the actual wind and solar power output is used as input to implement short-term decisions, whereas the dynamic programming (DP) method is used to build the model as a comparison to evaluate the power benefit and computational efficiency of the DQN model. The multi-energy complementary system of hydro, wind, and solar power of the Jinping-1 Hydropower Station in the Yalong river basin is used as an example for the study. In the flood season, compared with the DP model and the historical actual operation process, the total power generation benefits obtained from the DQN model's implementation of short-term decision-making increases by 6.18% and 1.38%, respectively. In the dry season, the total power generation benefits obtained from the DQN model's implementation of short-term decision-making increases by 2.26% and 19.00% respectively compared with the DP model and the historical actual operation process. Additionally, the DQN model can significantly improve the decision-making efficiency. The DP model requires minutes or hours of computation time; the DQN model consumes less than 1s to compute, which is conducive to efficient decision making of the complementary system.

A deep reinforcement learning ensemble for maintenance scheduling in offshore wind farms

Multi-Time-Scale Optimal Scheduling Strategy for Marine Renewable Energy Based on Deep Reinforcement Learning Algorithm

Research on short-term optimal scheduling of hydro-wind-solar multi-energy power system based on deep reinforcement learning

Optimization of the Operation and Maintenance of Renewable Energy Systems by Deep Reinforcement Learning

Jointly improving energy efficiency and smoothing power oscillations of integrated offshore wind and photovoltaic power: a deep reinforcement learning approach

Deep reinforcement learning for cost-optimal condition-based maintenance policy of offshore wind turbine components

Deep Reinforcement Learning for Distributed Flow Shop Scheduling with Flexible Maintenance

Mother-Daughter Vessel Operation and Maintenance Routing Optimization for Offshore Wind Farms Using Restructuring Particle Swarm Optimization

An Opportunistic Joint Maintenance Strategy for Two Offshore Wind Farms

Wind Farm Power Generation Control Via Double-Network-Based Deep Reinforcement Learning

Adaptive inter-area power oscillation damping from offshore wind farm and MMC-HVDC using deep reinforcement learning

Seizing Opportunity: Maintenance Optimization in Offshore Wind Farms Considering Accessibility, Production, and Crew Dispatch

Cooperative Wind Farm Control With Deep Reinforcement Learning and Knowledge-Assisted Learning

Advancing weather predictions for offshore wind farm maintenance through deep learning

Intelligent Wind Farm Control via Grouping-Based Reinforcement Learning

Intelligent Scheduling of Wind-Solar-Hydro-Battery Complementary System Based on Deep Reinforcement Learning

Intelligent Fault-Tolerant Active Power Control Using Reinforcement Learning for Offshore Wind Farms

Condition-based maintenance for the offshore wind turbine based on long short-term memory network

Deep Reinforcement Learning for Artificial Upwelling Energy Management

Integrated condition‐based maintenance modelling and optimisation for offshore wind turbines

A Reference Modelling Approach for Cost Optimal Maintenance for Offshore Wind Farms