Abstract:As the large-scale integration of renewable energy into the power grid, coal-fired power units have to undertake the task of load-frequency regulation, the optimization control of the coal-fired power units is becoming increasingly important. Reinforcement learning is being used for optimization control of the process increasingly but may encounter high learning costs. In this paper, a process model-assisted optimization control framework called PMA-OC is proposed to achieve the optimization control of coal-fired power unit. In this framework, a low-precision process model developed by process operation knowledge is employed to achieve the initial control based on model predictive control algorithm (MPC) and improve the dynamic characteristics of the coordinated control system. Then the deep reinforcement learning algorithm (DRL) is utilized to improve the initial control continuously, through constantly interacting with the improved process. With the full mining of process knowledge from the power unit, the improved process offers the better training samples for DRL, reduces the learning complexity of DRL, and strengthens the learning efficiency of DRL. Finally, the proposed control framework is employed to achieve the optimization control of the coordinated control system, and simulation results indicate that the proposed control framework outperforms the existing standalone MPC and DRL methods in terms of anti-interference ability, dynamic response time, and performs well control capability. Note to Practitioners—The flexible and stable operation of coal-fired power units is of great significance to the peak load regulation and supply guarantee of the power grid. For practitioners of the coal-fired power unit, this paper proposes a process model-assisted optimization control framework to promote the process knowledge utilization. In this framework, process knowledge is used to implement preliminary control on coal-fired power units to reduce the complex dynamic characteristics of coal-fired power units. Then, the reinforcement learning algorithm is used to continuously improve the control performance of coal-fired power units by interacting with the improved process. Finally, the effectiveness of the proposed method is verified by a supercritical unit. Although the proposed method is applied to the optimal control of coal-fired power units, its ideas can be used for the reference in other complex industrial processes.

Multi-Level Coordination Control Based on Multi-Agent Reinforcement Learning for the Pressure of Gas Collectors of Coke Ovens

A Method to Coordination for Decentralized Multi- Mpc Controllers in Integrated Plant

Multi-Agent Reinforcement Learning Control for Consensus Problems of Uncertain Nonlinear Multi-Agent Systems

Target-Value-Competition-Based Multi-Agent Deep Reinforcement Learning Algorithm for Distributed Nonconvex Economic Dispatch

Variable Structure Fuzzy Control for Gas Collector Pressure in Coke Oven

Multi-Agent Q-Value Mixing Network with Covariance Matrix Adaptation Strategy for the Voltage Regulation Problem

Model predictive coordinated cooperative control mechanism for multiagent systems based on priority negotiation

Coordinated control of gas supply system in PEMFC based on multi-agent deep reinforcement learning

Distributed deep reinforcement learning-based gas supply system coordination management method for solid oxide fuel cell

Coordinated Control Strategy of Electricity-Heat-Gas Integrated Energy System Considering Renewable Energy Uncertainty and Multi-Agent Mixed Game

Variable Structure Fuzzy Control Based on Particle Swarm Optimization for Gas Collector Pressure

Process Model-Assisted Optimization Control Method Based on Model Predictive Control and Deep Reinforcement Learning for Coordinated Control System in Coal-Fired Power Unit

Multi-Agent Deep Reinforcement Learning Based Consistency Control in Train Platoon Systems.

Secondary Voltage Collaborative Control of Distributed Energy System via Multi-Agent Reinforcement Learning

Adaptive Individual Q-Learning-A Multiagent Reinforcement Learning Method for Coordination Optimization

Comparative Evaluation of Different Multi-Agent Reinforcement Learning Mechanisms in Condenser Water System Control

Optimal control method of HVAC based on multi-agent deep reinforcement learning

Self-attention-based multi-agent continuous control method in cooperative environments

Bi-Level Actor-Critic for Multi-Agent Coordination.

Multi-Agent Optimal Control for Central Chiller Plants Using Reinforcement Learning and Game Theory

Networked Multiagent Safe Reinforcement Learning for Low-carbon Demand Management in Distribution Network