Abstract:This paper proposed a Deep Reinforcement learning (DRL) approach for Combined Heat and Power (CHP) system economic dispatch which obtain adaptability for different operating scenarios and significantly decrease the computational complexity without affecting accuracy. In the respect of problem description, a vast of Combined Heat and Power (CHP) economic dispatch problems are modeled as a high-dimensional and non-smooth objective function with a large number of non-linear constraints for which powerful optimization algorithms and considerable time are required to solve it. In order to reduce the solution time, most engineering applications choose to linearize the optimization target and devices model. To avoid complicated linearization process, this paper models CHP economic dispatch problems as Markov Decision Process (MDP) that making the model highly encapsulated to preserve the input and output characteristics of various devices. Furthermore, we improve an advanced deep reinforcement learning algorithm: distributed proximal policy optimization (DPPO), to make it applicable to CHP economic dispatch problem. Based on this algorithm, the agent will be trained to explore optimal dispatch strategies for different operation scenarios and respond to system emergencies efficiently. In the utility phase, the trained agent will generate optimal control strategy in real time based on current system state. Compared with existing optimization methods, advantages of DRL methods are mainly reflected in the following three aspects: 1) Adaptability: under the premise of the same network topology, the trained agent can handle the economic scheduling problem in various operating scenarios without recalculation. 2) High encapsulation: The user only needs to input the operating state to get the control strategy, while the optimization algorithm needs to re-write the constraints and other formulas for different situations. 3) Time scale flexibility: It can be applied to both the day-ahead optimized scheduling and the real-time control. The proposed method is applied to two test system with different characteristics. The results demonstrate that the DRL method could handle with varieties of operating situations while get better optimization performance than most of other algorithms.

Distributed Pareto Reinforcement Learning for Multi-objective Smart Generation Control of Multi-area Interconnected Power Systems

Multi-agent Deep Reinforcement Learning Algorithm for Distributed Economic Dispatch in Smart Grid.

Target-Value-Competition-Based Multi-Agent Deep Reinforcement Learning Algorithm for Distributed Nonconvex Economic Dispatch

Towards Pareto-optimal energy management in integrated energy systems: A multi-agent and multi-objective deep reinforcement learning approach

Multi-Objective Reinforcement Learning based Multi-Microgrid System Optimisation Problem

PowerNet: Multi-agent Deep Reinforcement Learning for Scalable Powergrid Control

Preference based multi-objective reinforcement learning for multi-microgrid system optimization problem in smart grid

Deep Reinforcement Learning Based Multi-Objective Integrated Automatic Generation Control for Multiple Continuous Power Disturbances

Multiagent Stochastic Dynamic Game for Smart Generation Control

Multi-Agent Correlated Equilibrium Q(λ) Learning for Coordinated Smart Generation Control of Interconnected Power Grids

Distributed deep reinforcement learning for integrated generation‐control and power‐dispatch of interconnected power grid with various renewable units

Finite Horizon Multi-Agent Reinforcement Learning in Solving Optimal Control of State-Dependent Switched Systems

Multi-objective Optimal Reactive Power Dispatch of Power Systems by Combining Classification Based Multi-objective Evolutionary Algorithm and Integrated Decision Making

Multi-Objective Interval Optimization Dispatch of Microgrid Via Deep Reinforcement Learning

PMDRL: Pareto-front-based Multi-Objective Deep Reinforcement Learning

Hybrid Modeling with Data Enhanced Driven Learning Algorithm for Smart Generation Control in Multi-Area Integrated Energy Systems with High Proportion Renewable Energy

Large-scale deep reinforcement learning method for energy management of power supply units considering regulation mileage payment

Combined heat and power system intelligent economic dispatch: A deep reinforcement learning approach

Multi-agent Deep Reinforcement Learning for Distributed Energy Management and Strategy Optimization of Microgrid Market

Multiagent-Based Reinforcement Learning for Optimal Reactive Power Dispatch.

Multi-Network Constrained Operational Optimization in Community Integrated Energy Systems: A Safe Reinforcement Learning Approach