Abstract:Recently, grid-integrated wind power and photovoltaics have experienced rapid growth. However, their uncertainty increases the difficulty of grid scheduling and operation. Short-term power generation decisions made by conventional scheduling methods, which are based on the output forecast information of wind and solar power often impact the power benefit owing to forecast errors during the actual operation. This study explores the application of deep reinforcement learning methods for short-term optimal scheduling of hydro-wind-solar multi-energy power system, considering forecast uncertainty. First, with the objective of maximizing power generation benefit from the multi-energy complementary system, the Deep Q Network (DQN) method in deep reinforcement learning is employed to construct the model framework of the short-term optimal scheduling of hydro-wind-solar multi-energy power system (collectively referred to as DQN model later). Thereafter, the impact of each learning parameter in the DQN model on performances is analyzed, and the model parameters are reasonably configured. Furthermore, the DQN model is driven by wind and solar power output forecast data to develop short-term power generation decisions. Finally, the actual wind and solar power output is used as input to implement short-term decisions, whereas the dynamic programming (DP) method is used to build the model as a comparison to evaluate the power benefit and computational efficiency of the DQN model. The multi-energy complementary system of hydro, wind, and solar power of the Jinping-1 Hydropower Station in the Yalong river basin is used as an example for the study. In the flood season, compared with the DP model and the historical actual operation process, the total power generation benefits obtained from the DQN model's implementation of short-term decision-making increases by 6.18% and 1.38%, respectively. In the dry season, the total power generation benefits obtained from the DQN model's implementation of short-term decision-making increases by 2.26% and 19.00% respectively compared with the DP model and the historical actual operation process. Additionally, the DQN model can significantly improve the decision-making efficiency. The DP model requires minutes or hours of computation time; the DQN model consumes less than 1s to compute, which is conducive to efficient decision making of the complementary system.

Intelligent Scheduling of Wind-Solar-Hydro-Battery Complementary System Based on Deep Reinforcement Learning

Multi-Agent Reinforcement Learning Based Scheduling for Distributed PV-ESS Considering Incomplete Data Acquisition

Research on short-term optimal scheduling of hydro-wind-solar multi-energy power system based on deep reinforcement learning

Multi-objective Optimal Scheduling of Power Systems Based on Complementary Characteristics of Heterogeneous Energy Sources

Real-time Economic Dispatch of Thermal-Wind-Battery Hybrid Systems Based on Deep Reinforcement Learning

Multi-objective two-stage robust optimization of wind/PV/thermal power system based on meta multi-agent reinforcement learning

Optimal dispatch of integrated energy system based on deep reinforcement learning

Joint Optimization Dispatching for Hybrid Power System Based on Deep Reinforcement Learning

The key technology for optimal scheduling and control of wind-photovoltaic-storage multi-energy complementary system

Optimal Configuration of Multi-energy Capacity Based on Complementary Characteristics of Wind, Solar, Hydro, Thermal, and Battery Energy

Optimal Scheduling of the Wind-Photovoltaic-Energy Storage Multi-Energy Complementary System Considering Battery Service Life

Scale and Scheduling Collaborative Optimization Based on Power Redistribution of Wind-solar-battery Hybrid Systems

Multi-Objective Optimal Dispatch Of Power Systems Integrated With Intermittent Renewable Energy Considering Demand Response

Multi-Time-Scale Optimal Scheduling Strategy for Marine Renewable Energy Based on Deep Reinforcement Learning Algorithm

Deep Reinforcement Learning-driven Cross-Community Energy Interaction Optimal Scheduling

Multi-Time-Scale Coordinated Optimum Scheduling Technique for a Multi-Source Complementary Power-Generating System with Uncertainty in the Source-Load

A Control Strategy Based on Deep Reinforcement Learning Under the Combined Wind-Solar Storage System

Analysis of hybrid wind-photovoltaic-hydro generation system based on short-term scheduling

Stochastic short-term scheduling of a wind-solar-hydro complementary system considering both the day-ahead market bidding and bilateral contracts decomposition

Data-driven optimal energy management for a wind-solar-diesel-battery-reverse osmosis hybrid energy system using a deep reinforcement learning approach

Deep Reinforcement Learning-Based Method for Joint Optimization of Mobile Energy Storage Systems and Power Grid with High Renewable Energy Sources