Abstract:This paper proposed a Deep Reinforcement learning (DRL) approach for Combined Heat and Power (CHP) system economic dispatch which obtain adaptability for different operating scenarios and significantly decrease the computational complexity without affecting accuracy. In the respect of problem description, a vast of Combined Heat and Power (CHP) economic dispatch problems are modeled as a high-dimensional and non-smooth objective function with a large number of non-linear constraints for which powerful optimization algorithms and considerable time are required to solve it. In order to reduce the solution time, most engineering applications choose to linearize the optimization target and devices model. To avoid complicated linearization process, this paper models CHP economic dispatch problems as Markov Decision Process (MDP) that making the model highly encapsulated to preserve the input and output characteristics of various devices. Furthermore, we improve an advanced deep reinforcement learning algorithm: distributed proximal policy optimization (DPPO), to make it applicable to CHP economic dispatch problem. Based on this algorithm, the agent will be trained to explore optimal dispatch strategies for different operation scenarios and respond to system emergencies efficiently. In the utility phase, the trained agent will generate optimal control strategy in real time based on current system state. Compared with existing optimization methods, advantages of DRL methods are mainly reflected in the following three aspects: 1) Adaptability: under the premise of the same network topology, the trained agent can handle the economic scheduling problem in various operating scenarios without recalculation. 2) High encapsulation: The user only needs to input the operating state to get the control strategy, while the optimization algorithm needs to re-write the constraints and other formulas for different situations. 3) Time scale flexibility: It can be applied to both the day-ahead optimized scheduling and the real-time control. The proposed method is applied to two test system with different characteristics. The results demonstrate that the DRL method could handle with varieties of operating situations while get better optimization performance than most of other algorithms.

A Reinforcement Learning Approach for Branch Overload Relief in Power Systems

A Deep Reinforcement Learning Based Approach for Optimal Active Power Dispatch

A Graph-based Deep Reinforcement Learning Framework for Autonomous Power Dispatch on Power Systems with Changing Topologies

A Data-driven Method for Fast AC Optimal Power Flow Solutions via Deep Reinforcement Learning

Optimizing Load Scheduling in Power Grids Using Reinforcement Learning and Markov Decision Processes

Alleviating Imbalanced Problems of Reinforcement Learning when Applying in Real-Time Power Network Dispatching and Control

A Safe DRL Method for Fast Solution of Real-Time Optimal Power Flow

Power Flow Rebalancing in Optimal Scheduling of Smart Distribution Systems Based on Deep Deterministic Policy Gradient

Reinforcement Learning for Efficient Power Systems Planning: A Review of Operational and Expansion Strategies

Economic dispatch of industrial park considering uncertainty of renewable energy based on a deep reinforcement learning approach

Real-Time Optimal Power Flow Method Via Safe Deep Reinforcement Learning Based on Primal-Dual and Prior Knowledge Guidance

On Fast-Converged Deep Reinforcement Learning for Optimal Dispatch of Large-Scale Power Systems under Transient Security Constraints

Multiagent-Based Reinforcement Learning for Optimal Reactive Power Dispatch.

Power System Emergency Control to Improve Short-Term Voltage Stability Using Deep Reinforcement Learning Algorithm

PowRL: A Reinforcement Learning Framework for Robust Management of Power Networks

Applications of Reinforcement Learning in Deregulated Power Market: A Comprehensive Review

Deep Reinforcement Learning for Economic Dispatch of Virtual Power Plant in Internet of Energy.

Adaptive Power System Emergency Control using Deep Reinforcement Learning

Low-Carbon-Oriented Physical Information Graph Representation for Deep Reinforcement Learning in Power System Real-time Dispatch

Combined heat and power system intelligent economic dispatch: A deep reinforcement learning approach

Online Preventive Control for Transmission Overload Relief Using Safe Reinforcement Learning with Enhanced Spatial-Temporal Awareness