Abstract:The proliferation of distributed renewable energy resources (RESs) poses major challenges to the operation of microgrids due to uncertainty. Traditional online scheduling approaches relying on accurate forecasts become difficult to implement due to the increase of uncertain RESs. Although several data-driven methods have been proposed recently to overcome the challenge, they generally suffer from a scalability issue due to the limited ability to optimize high-dimensional continuous control variables. To address these issues, we propose a data-driven online scheduling method for microgrid energy optimization based on continuous-control deep reinforcement learning (DRL). We formulate the online scheduling problem as a Markov decision process (MDP). The objective is to minimize the operating cost of the microgrid considering the uncertainty of RESs generation, load demand, and electricity prices. To learn the optimal scheduling strategy, a Gated Recurrent Unit (GRU)-based network is designed to extract temporal features of uncertainty and generate the optimal scheduling decisions in an end-to-end manner. To optimize the policy with high-dimensional and continuous actions, proximal policy optimization (PPO) is employed to train the neural network-based policy in a data-driven fashion. The proposed method does not require any forecasting information on the uncertainty or a prior knowledge of the physical model of the microgrid. Simulation results using realistic power system data of California Independent System Operator (CAISO) demonstrate the effectiveness of the proposed method.

A Deep-Reinforcement-Learning-based Optimal Scheduling for Rural Integrated Energy System Considering the Uncertainties of Renewable Energies and Loads

Multi-Agent Reinforcement Learning Based Scheduling for Distributed PV-ESS Considering Incomplete Data Acquisition

Real-Time Scheduling Method Based on Deep Reinforcement Learning for a Hybrid Wind-Solar-Storage Energy Generation System

Dynamic economic dispatch of power system based on DDPG algorithm

Data-Driven Online Energy Scheduling of a Microgrid Based on Deep Reinforcement Learning

Optimal Energy System Scheduling Using A Constraint-Aware Reinforcement Learning Algorithm

Research on Data-Driven Optimal Scheduling of Power System

Optimal Scheduling in IoT-Driven Smart Isolated Microgrids Based on Deep Reinforcement Learning

Dynamic optimization of an integrated energy system with carbon capture and power-to-gas interconnection: A deep reinforcement learning-based scheduling strategy

Optimal dispatch of integrated energy system based on deep reinforcement learning

Deep Reinforcement Learning-driven Cross-Community Energy Interaction Optimal Scheduling

Optimizing Load Scheduling in Power Grids Using Reinforcement Learning and Markov Decision Processes

Model-data-event Based Community Integrated Energy System Low-Carbon Economic Scheduling

Optimal Scheduling of a Wind Energy Dominated Distribution Network Via a Deep Reinforcement Learning Approach

Real-Time Scheduling of High-Penetrated Renewable Power Systems: an Expert Knowledge and Reinforcement Learning Hybrid Approach

Real-time optimization of large-scale hydrogen production systems using off-grid renewable energy: Scheduling strategy based on deep reinforcement learning

Optimal operation of regional integrated energy system based on multi-agent deep deterministic policy gradient algorithm

Optimal scheduling of integrated energy system considering renewable energy uncertainties based on distributionally robust adaptive MPC

Deep Reinforcement Learning for Community Battery Scheduling under Uncertainties of Load, PV Generation, and Energy Prices

Economic dispatch of industrial park considering uncertainty of renewable energy based on a deep reinforcement learning approach

A Deep Reinforcement Learning Based Approach for Optimal Active Power Dispatch