Abstract:This paper proposed a Deep Reinforcement learning (DRL) approach for Combined Heat and Power (CHP) system economic dispatch which obtain adaptability for different operating scenarios and significantly decrease the computational complexity without affecting accuracy. In the respect of problem description, a vast of Combined Heat and Power (CHP) economic dispatch problems are modeled as a high-dimensional and non-smooth objective function with a large number of non-linear constraints for which powerful optimization algorithms and considerable time are required to solve it. In order to reduce the solution time, most engineering applications choose to linearize the optimization target and devices model. To avoid complicated linearization process, this paper models CHP economic dispatch problems as Markov Decision Process (MDP) that making the model highly encapsulated to preserve the input and output characteristics of various devices. Furthermore, we improve an advanced deep reinforcement learning algorithm: distributed proximal policy optimization (DPPO), to make it applicable to CHP economic dispatch problem. Based on this algorithm, the agent will be trained to explore optimal dispatch strategies for different operation scenarios and respond to system emergencies efficiently. In the utility phase, the trained agent will generate optimal control strategy in real time based on current system state. Compared with existing optimization methods, advantages of DRL methods are mainly reflected in the following three aspects: 1) Adaptability: under the premise of the same network topology, the trained agent can handle the economic scheduling problem in various operating scenarios without recalculation. 2) High encapsulation: The user only needs to input the operating state to get the control strategy, while the optimization algorithm needs to re-write the constraints and other formulas for different situations. 3) Time scale flexibility: It can be applied to both the day-ahead optimized scheduling and the real-time control. The proposed method is applied to two test system with different characteristics. The results demonstrate that the DRL method could handle with varieties of operating situations while get better optimization performance than most of other algorithms.

Hybrid Model-and-Data-Driven Combined Heat and Power Economic Dispatch Based on Heterogeneous Decomposition

Combined Heat and Power Dispatch Using Simplified District Heat Flow Model

Coordinated Dispatch of Integrated Electric and District Heating Systems Using Heterogeneous Decomposition

Optimal Coordination of Chp Plants with Renewable Energy Generation Considering Substitutability Between Electricity and Heat

Fully Distributed Optimization for Combined Heat and Power Dispatch

Combined heat and power system intelligent economic dispatch: A deep reinforcement learning approach

Exploiting Flexibility of District Heating Networks in Combined Heat and Power Dispatch

Flexibility Oriented Combined Heat and Power Dispatch under Uncertainties

Hybridization of Harmony Search with Nelder-Mead Algorithm for Combined Heat and Power Economic Dispatch Problem

Decentralized Solution for Combined Heat and Power Dispatch Through Benders Decomposition

An Economic Dispatch Model for Combined Heat and Power Systems Considering the Characteristics of Heat Recovery Steam Generators

Combined Economic Dispatch Considering the Time-Delay of District Heating Network and Multi-Regional Indoor Temperature Control

Combined Heat and Power Dispatch Considering Pipeline Energy Storage of District Heating Network

Hierarchical Dispatch Method for Integrated Heat and Power Systems Considering the Heat Transfer Process

Data-driven Optimal Dynamic Dispatch for Hydro-PV-PHS Integrated Power Systems Using Deep Reinforcement Learning Approach

Coordinated Dispatch of Electric Power and District Heating Networks: A Decentralized Solution Using Optimality Condition Decomposition

A Water Mass Method and Its Application to Integrated Heat and Electricity Dispatch Considering Thermal Dynamics

Distributed Conditional-Distributionally Robust Coordination for an Electrical Power and Flexibility-Enhanced District Heating System

Coordinated Dispatch of Power and Transportation Systems Considering Hydrogen Storage Based on Heterogeneous Decomposition

Deep Reinforcement Learning Based Energy Scheduling of a Hybrid Electricity/Heat/Hydrogen Energy System

Solving combined heat and power economic dispatch using a mixed integer model