Abstract:As the large-scale integration of renewable energy into the power grid, coal-fired power units have to undertake the task of load-frequency regulation, the optimization control of the coal-fired power units is becoming increasingly important. Reinforcement learning is being used for optimization control of the process increasingly but may encounter high learning costs. In this paper, a process model-assisted optimization control framework called PMA-OC is proposed to achieve the optimization control of coal-fired power unit. In this framework, a low-precision process model developed by process operation knowledge is employed to achieve the initial control based on model predictive control algorithm (MPC) and improve the dynamic characteristics of the coordinated control system. Then the deep reinforcement learning algorithm (DRL) is utilized to improve the initial control continuously, through constantly interacting with the improved process. With the full mining of process knowledge from the power unit, the improved process offers the better training samples for DRL, reduces the learning complexity of DRL, and strengthens the learning efficiency of DRL. Finally, the proposed control framework is employed to achieve the optimization control of the coordinated control system, and simulation results indicate that the proposed control framework outperforms the existing standalone MPC and DRL methods in terms of anti-interference ability, dynamic response time, and performs well control capability. Note to Practitioners—The flexible and stable operation of coal-fired power units is of great significance to the peak load regulation and supply guarantee of the power grid. For practitioners of the coal-fired power unit, this paper proposes a process model-assisted optimization control framework to promote the process knowledge utilization. In this framework, process knowledge is used to implement preliminary control on coal-fired power units to reduce the complex dynamic characteristics of coal-fired power units. Then, the reinforcement learning algorithm is used to continuously improve the control performance of coal-fired power units by interacting with the improved process. Finally, the effectiveness of the proposed method is verified by a supercritical unit. Although the proposed method is applied to the optimal control of coal-fired power units, its ideas can be used for the reference in other complex industrial processes.

Intelligent Method to Optimize the Frequency Modulation for Beam Pumping System Based on Deep Reinforcement Learning

Modeling and Optimization of Beam Pumping System Based on Intelligent Computing for Energy Saving.

Model-Free Load Frequency Control of Nonlinear Power Systems Based on Deep Reinforcement Learning

A Deep Reinforcement Learning Based Framework for Power System Load Frequency Control

Optimization Frequency of Stroke Based on Submergence Depth SVM Forecasting of Submersible Pump

A Control Method to Balance the Efficiency and Reliability of a Time-Delayed Pump-Valve System

Improved Virtual Inertia Control Strategy of Doubly Fed Pumped Storage Unit for Power Network Frequency Modulation

Modeling and Control for Beam Pumping Units: An Overview

Optimizing a Superconducting Radiofrequency Gun Using Deep Reinforcement Learning

Power System Load Frequency Active Disturbance Rejection Control Via Reinforcement Learning-Based Memetic Particle Swarm Optimization

Wide Area Measurement System-based Low Frequency Oscillation Damping Control through Reinforcement Learning

Process Model-Assisted Optimization Control Method Based on Model Predictive Control and Deep Reinforcement Learning for Coordinated Control System in Coal-Fired Power Unit

A Multiagent Reinforcement Learning Approach for Wind Farm Frequency Control

Towards Beam Hopping and Power Allocation in Multi-Beam Satellite Systems with Parameterized Reinforcement Learning

A Transfer and Deep Learning-Based Method for Online Frequency Stability Assessment and Control

Deep Reinforcement Learning Enabled Bi-Level Robust Parameter Optimization of Hydropower-Dominated Systems for Damping Ultra-Low Frequency Oscillation

Zone Scheduling Optimization of Pumps in Water Distribution Networks with Deep Reinforcement Learning and Knowledge-Assisted Learning

Frequency conversion control system of long stroke non-beam pumping unit based on PLC

Stable Reinforcement Learning for Optimal Frequency Control: A Distributed Averaging-Based Integral Approach

Pump Scheduling Optimization in Urban Water Supply Stations: A Physics‐Informed Multiagent Deep Reinforcement Learning Approach