Abstract:Integrated energy system (IES) is becoming a mainstream form of energy system decarbonization benefiting from the efficient use of multi-energy carriers and user-friendliness to distributed energy resources. Along with the development of IES, the coordinated operation is necessary to further improve the general efficiency of the IES cluster. Conventional distributed optimization methods are difficult to coordinately optimize the IES cluster operation, considering the balance of the computational time, convergence performance, and initial value determination. This paper proposes a coordinated optimal dispatching approach for the IES cluster based on improved deep reinforcement learning. Firstly, a distributed scheduling framework of the IES cluster with a cluster energy coordination center (CECC) as the upper coordinator and several area energy management centers (AEMCs) as the lower managers is introduced. Secondly, the energy interaction model and pricing strategy in the IES cluster that can facilitate multi-energy transactions are established. Finally, an improved multi-agent deep deterministic policy gradient (MADDPG) algorithm with a compression mechanism of initial state space is proposed for the model solution. Results show that compared with the conventional distributed algorithm of the alternating direction method of multipliers (ADMM), the improved MADDPG increases the solving speed by 40 times when guaranteeing the convergence and optimality of the solution. Besides, after considering energy transactions among IESs in the cluster, the total operating cost is reduced by 9.74%, and the self-sufficient ratio is raised to 0.92, reflecting the necessity of energy complementarity.

Optimal operation of regional integrated energy system based on multi-agent deep deterministic policy gradient algorithm

Multi-agent optimal scheduling for integrated energy system considering the global carbon emission constraint

Multi-Agent Reinforcement Learning Based Scheduling for Distributed PV-ESS Considering Incomplete Data Acquisition

Coordinated optimal dispatching approach for integrated energy system cluster based on improved deep reinforcement learning

Deep Reinforcement Learning Based Optimal Scheduling of Active Distribution System Considering Distributed Generation, Energy Storage and Flexible Load

Distributed optimization of electricity-Gas-Heat integrated energy system with multi-agent deep reinforcement learning

Power Flow Rebalancing in Optimal Scheduling of Smart Distribution Systems Based on Deep Deterministic Policy Gradient

Demand-Side Frequency Control in Power Network Based on Multi-Agent Deep Reinforcement Learning

A Deep-Reinforcement-Learning-based Optimal Scheduling for Rural Integrated Energy System Considering the Uncertainties of Renewable Energies and Loads

MADDPG-Based Active Distribution Network Dynamic Reconfiguration with Renewable Energy

A Scalable and Coordinated Energy Management for Electric Vehicles Based on Multiagent Reinforcement Learning Method

Large-scale deep reinforcement learning method for energy management of power supply units considering regulation mileage payment

Evolutionary computing assisted deep reinforcement learning for multi-objective integrated energy system management

Hierarchical Multi-Agent Deep Reinforcement Learning for Multi-Objective Dispatching in Smart Grid

Deep Reinforcement Learning-based Multi-Scenario Multi-Scale Economic Scheduling for Integrated Energy Systems

Deep Reinforcement Learning-driven Cross-Community Energy Interaction Optimal Scheduling

Multi-Agent Reinforcement Learning for Smart Community Energy Management

Optimal demand response based dynamic pricing strategy via Multi-Agent Federated Twin Delayed Deep Deterministic policy gradient algorithm

Multi-agent system consistency-based cooperative scheduling strategy of regional integrated energy system

Agent-Based Energy Sharing Mechanism Using Deep Deterministic Policy Gradient Algorithm

Dynamic economic dispatch of power system based on DDPG algorithm