Abstract:Integrated energy system (IES) is becoming a mainstream form of energy system decarbonization benefiting from the efficient use of multi-energy carriers and user-friendliness to distributed energy resources. Along with the development of IES, the coordinated operation is necessary to further improve the general efficiency of the IES cluster. Conventional distributed optimization methods are difficult to coordinately optimize the IES cluster operation, considering the balance of the computational time, convergence performance, and initial value determination. This paper proposes a coordinated optimal dispatching approach for the IES cluster based on improved deep reinforcement learning. Firstly, a distributed scheduling framework of the IES cluster with a cluster energy coordination center (CECC) as the upper coordinator and several area energy management centers (AEMCs) as the lower managers is introduced. Secondly, the energy interaction model and pricing strategy in the IES cluster that can facilitate multi-energy transactions are established. Finally, an improved multi-agent deep deterministic policy gradient (MADDPG) algorithm with a compression mechanism of initial state space is proposed for the model solution. Results show that compared with the conventional distributed algorithm of the alternating direction method of multipliers (ADMM), the improved MADDPG increases the solving speed by 40 times when guaranteeing the convergence and optimality of the solution. Besides, after considering energy transactions among IESs in the cluster, the total operating cost is reduced by 9.74%, and the self-sufficient ratio is raised to 0.92, reflecting the necessity of energy complementarity.

Optimal dispatch of an integrated energy system based on deep reinforcement learning considering new energy uncertainty

Optimal dispatch of integrated energy system based on deep reinforcement learning

Intraday Optimal Dispatch of Integrated Energy System Based on Dynamic Models

Dynamic Energy Dispatch Strategy for Integrated Energy System Based on Improved Deep Reinforcement Learning

Two-stage Dispatching for Urban Integrated Energy System Considering Uncertainty and Interactive Power

Deep-Reinforcement-Learning-Based Low-Carbon Economic Dispatch for Community-Integrated Energy System under Multiple Uncertainties

An Integrated Demand Response-Based Energy Management Strategy for Integrated Energy System Based on Deep Reinforcement Learning

Dynamic energy dispatch strategy for integrated energy system based on constrained reinforcement learning

Real-time dispatch of an integrated energy system based on multi-stage reinforcement learning with an improved action-choosing strategy

Data-driven Optimal Dynamic Dispatch for Hydro-PV-PHS Integrated Power Systems Using Deep Reinforcement Learning Approach

Reinforcement Learning Based Energy Internet System Optimal Dispatch: A Survey

Joint Optimization Dispatching for Hybrid Power System Based on Deep Reinforcement Learning

Coordinated optimal dispatching approach for integrated energy system cluster based on improved deep reinforcement learning

An advanced real-time dispatching strategy for a distributed energy system based on the reinforcement learning algorithm

Optimal Dispatch for Integrated Energy System Considering Integrated Demand Response and the Uncertainties of Renewable Energy Resources

Real-time Economic Dispatch of Thermal-Wind-Battery Hybrid Systems Based on Deep Reinforcement Learning

Dynamic Optimization of on‐Grid Integrated Energy System Considering Peak‐Shaving Demand Via Learning Methods

Distributed optimization of electricity-Gas-Heat integrated energy system with multi-agent deep reinforcement learning

Optimal Evolutionary Dispatch for Integrated Community Energy Systems Considering Uncertainties of Renewable Energy Sources and Internal Loads

Multi-time Scale Optimal Dispatching of Electric-Thermal Integrated Energy System Considering Multiple Uncertainties

Hierarchical deep reinforcement learning for self-adaptive economic dispatch