Abstract:This paper proposed a Deep Reinforcement learning (DRL) approach for Combined Heat and Power (CHP) system economic dispatch which obtain adaptability for different operating scenarios and significantly decrease the computational complexity without affecting accuracy. In the respect of problem description, a vast of Combined Heat and Power (CHP) economic dispatch problems are modeled as a high-dimensional and non-smooth objective function with a large number of non-linear constraints for which powerful optimization algorithms and considerable time are required to solve it. In order to reduce the solution time, most engineering applications choose to linearize the optimization target and devices model. To avoid complicated linearization process, this paper models CHP economic dispatch problems as Markov Decision Process (MDP) that making the model highly encapsulated to preserve the input and output characteristics of various devices. Furthermore, we improve an advanced deep reinforcement learning algorithm: distributed proximal policy optimization (DPPO), to make it applicable to CHP economic dispatch problem. Based on this algorithm, the agent will be trained to explore optimal dispatch strategies for different operation scenarios and respond to system emergencies efficiently. In the utility phase, the trained agent will generate optimal control strategy in real time based on current system state. Compared with existing optimization methods, advantages of DRL methods are mainly reflected in the following three aspects: 1) Adaptability: under the premise of the same network topology, the trained agent can handle the economic scheduling problem in various operating scenarios without recalculation. 2) High encapsulation: The user only needs to input the operating state to get the control strategy, while the optimization algorithm needs to re-write the constraints and other formulas for different situations. 3) Time scale flexibility: It can be applied to both the day-ahead optimized scheduling and the real-time control. The proposed method is applied to two test system with different characteristics. The results demonstrate that the DRL method could handle with varieties of operating situations while get better optimization performance than most of other algorithms.

Real-time dispatch of an integrated energy system based on multi-stage reinforcement learning with an improved action-choosing strategy

Dynamic Energy Dispatch Strategy for Integrated Energy System Based on Improved Deep Reinforcement Learning

Soft Actor-Critic DRL Algorithm for Interval Optimal Dispatch of Integrated Energy Systems with Uncertainty in Demand Response and Renewable Energy

Optimal dispatch of an integrated energy system based on deep reinforcement learning considering new energy uncertainty

Dynamic energy dispatch strategy for integrated energy system based on constrained reinforcement learning

Hierarchical deep reinforcement learning for self-adaptive economic dispatch

Optimal dispatch of integrated energy system based on deep reinforcement learning

Local Integrated Energy System Operational Optimization Considering Multi-Type Uncertainties: A Reinforcement Learning Approach Based on Improved TD3 Algorithm

Low-carbon Economic Dispatch of Electricity-Heat-Gas Integrated Energy Systems Based on Deep Reinforcement Learning

An advanced real-time dispatching strategy for a distributed energy system based on the reinforcement learning algorithm

Two-stage Dispatching for Urban Integrated Energy System Considering Uncertainty and Interactive Power

An Improved Deep Reinforcement Learning Method for Dispatch Optimization Strategy of Modern Power Systems

Combined heat and power system intelligent economic dispatch: A deep reinforcement learning approach

A Data-Driven Approach Towards Fast Economic Dispatch in Integrated Electricity and Natural Gas System

Coordinated energy management for integrated energy system incorporating multiple flexibility measures of supply and demand sides: A deep reinforcement learning approach

Multi-objective Explainable Smart Dispatch for Integrated Energy System Based on an Explainable MO-RL Method

Real-time Economic Dispatch of Thermal-Wind-Battery Hybrid Systems Based on Deep Reinforcement Learning

Deep-Reinforcement-Learning-Based Low-Carbon Economic Dispatch for Community-Integrated Energy System under Multiple Uncertainties

Dueling Double Q-learning Based Real-time Energy Dispatch in Grid-connected Microgrids

Multi-Objective Interval Optimization Dispatch of Microgrid Via Deep Reinforcement Learning

Deep Reinforcement Learning-Based Scheduling Optimization of a Wind-solar Coupled CHP Unit System Considering Source-load Uncertainty