Abstract:An integrated energy system (IES) is combined with electricity, gas and heating subnetworks to satisfy various loads, which results in a complicated energy coupling. Considering the power interaction between IES and power grid, the real‐time dynamic optimal dispatch policies for the on‐grid IES are proposed and compared by learning methods to improve the operation economic and peak‐shaving performances in this study. Owing to the uncertainties of the load demands and real‐time peak‐shaving demand and renewable energy, together with the sequential operation of the controllable sources, the energy dispatch optimization problem of the IES is described as a stochastic dynamic optimization process. A source‐load collaborative operation mode is proposed as the coupling of thermal energy and electrical power in the IES and compared with different energy dispatching mode. And reinforcement learning methods are adopted to achieve the dynamic optimal policy. Since the multiple systems with energy coupling would result in modeling difficulty and dimension curse during the optimization, a deep reinforcement learning method (DDQN) is used to solve this problem. A numerical analysis is performed by comprehensively comparing the different learning algorithms and operation modes, and the simulation results show that the derived dispatch policy achieved by DDQN method with source‐load collaboration can effectively improve the performance of the IES in the stochastic environment. © 2022 Institute of Electrical Engineers of Japan. Published by Wiley Periodicals LLC.

Dynamic Energy Dispatch Strategy for Integrated Energy System Based on Improved Deep Reinforcement Learning

Optimal dispatch of an integrated energy system based on deep reinforcement learning considering new energy uncertainty

Low-carbon Economic Dispatch of Electricity-Heat-Gas Integrated Energy Systems Based on Deep Reinforcement Learning

Real-time dispatch of an integrated energy system based on multi-stage reinforcement learning with an improved action-choosing strategy

Optimal dispatch of integrated energy system based on deep reinforcement learning

Economic dispatch of industrial park considering uncertainty of renewable energy based on a deep reinforcement learning approach

Dynamic economic dispatch of power system based on DDPG algorithm

Hierarchical deep reinforcement learning for self-adaptive economic dispatch

Deep Reinforcement Learning Based Acceleration Approach for Day-Ahead Optimal Dispatch of Integrated Energy Systems

An advanced real-time dispatching strategy for a distributed energy system based on the reinforcement learning algorithm

An Integrated Demand Response-Based Energy Management Strategy for Integrated Energy System Based on Deep Reinforcement Learning

Dynamic Energy Dispatch Based on Deep Reinforcement Learning in IoT-Driven Smart Isolated Microgrids

A Deep Reinforcement Learning Based Approach for Optimal Active Power Dispatch

A Data-Driven Approach Towards Fast Economic Dispatch in Integrated Electricity and Natural Gas System

Dynamic Optimization of on‐Grid Integrated Energy System Considering Peak‐Shaving Demand Via Learning Methods

A Deep-Reinforcement-Learning-based Optimal Scheduling for Rural Integrated Energy System Considering the Uncertainties of Renewable Energies and Loads

Deep Reinforcement Learning–based Approach for Optimizing Energy Conversion in Integrated Electrical and Heating System with Renewable Energy

Real-time Economic Dispatch of Thermal-Wind-Battery Hybrid Systems Based on Deep Reinforcement Learning

Dynamic optimization of an integrated energy system with carbon capture and power-to-gas interconnection: A deep reinforcement learning-based scheduling strategy

A Constraint Enforcement Deep Reinforcement Learning Framework for Optimal Energy Storage Systems Dispatch

Stochastic dispatch of energy storage in microgrids: An augmented reinforcement learning approach