Abstract:As the large-scale integration of renewable energy into the power grid, coal-fired power units have to undertake the task of load-frequency regulation, the optimization control of the coal-fired power units is becoming increasingly important. Reinforcement learning is being used for optimization control of the process increasingly but may encounter high learning costs. In this paper, a process model-assisted optimization control framework called PMA-OC is proposed to achieve the optimization control of coal-fired power unit. In this framework, a low-precision process model developed by process operation knowledge is employed to achieve the initial control based on model predictive control algorithm (MPC) and improve the dynamic characteristics of the coordinated control system. Then the deep reinforcement learning algorithm (DRL) is utilized to improve the initial control continuously, through constantly interacting with the improved process. With the full mining of process knowledge from the power unit, the improved process offers the better training samples for DRL, reduces the learning complexity of DRL, and strengthens the learning efficiency of DRL. Finally, the proposed control framework is employed to achieve the optimization control of the coordinated control system, and simulation results indicate that the proposed control framework outperforms the existing standalone MPC and DRL methods in terms of anti-interference ability, dynamic response time, and performs well control capability. Note to Practitioners—The flexible and stable operation of coal-fired power units is of great significance to the peak load regulation and supply guarantee of the power grid. For practitioners of the coal-fired power unit, this paper proposes a process model-assisted optimization control framework to promote the process knowledge utilization. In this framework, process knowledge is used to implement preliminary control on coal-fired power units to reduce the complex dynamic characteristics of coal-fired power units. Then, the reinforcement learning algorithm is used to continuously improve the control performance of coal-fired power units by interacting with the improved process. Finally, the effectiveness of the proposed method is verified by a supercritical unit. Although the proposed method is applied to the optimal control of coal-fired power units, its ideas can be used for the reference in other complex industrial processes.

Multi-objective optimization of thermal power and outlet steam temperature for a nuclear steam supply system with deep reinforcement learning

Deep-learning modeling and control optimization framework for intelligent thermal power plants: A practice on superheated steam temperature

Multilayer Perception Based Reinforcement Learning Supervisory Control of Energy Systems with Application to a Nuclear Steam Supply System

Optimized Thermal Power Control for Nuclear Superheated-Steam Supply Systems Based on Multi-Layer Perception

Dynamic Matrix Control for the Thermal Power of MHTGR-Based Nuclear Steam Supply System

Multi-objective optimization for advanced superheater steam temperature control in a 300 MW power plant

Modular Modeling and Trust Region Based Real-Time Optimization for Load Changes in Modular High Temperature Gas-Cooled Reactor

Multi-layer Perception Based Model Predictive Control for the Thermal Power of Nuclear Superheated-Steam Supply Systems

Performance Optimization of a Steam Generator Level Control System via a Revised Simplex Search-Based Data-Driven Optimization Methodology

A power regulation strategy for heat pipe cooled reactors based on deep learning and hybrid data-driven optimization algorithm

Deep Reinforcement Learning based Optimal Control of Hot Water Systems

Dynamic Matrix Control of Thermal Power for Multiple Nuclear Steam Supply System Modules

Physics-informed Reinforcement Learning optimization of PWR core loading pattern

Dynamic matrix control for thermal power of multi-modular high temperature gas-cooled reactor plants

Process Model-Assisted Optimization Control Method Based on Model Predictive Control and Deep Reinforcement Learning for Coordinated Control System in Coal-Fired Power Unit

A Safe Reinforcement Learning Algorithm for Supervisory Control of Power Plants

Constrained Nonlinear Model Predictive Control for High Temperature Gas-Cooled Reactor in Load Following

Model-free Adaptive Control Law for Nuclear Superheated-Steam Supply Systems

Design Optimization of Nuclear Fusion Reactor through Deep Reinforcement Learning

Nonlinear Adaptive Coordinated Control For High Temperature Gas-Cooled Nuclear Steam Supplying Systems

Parameter Optimization of Steam Generator Water Level Control System Based on Piecewise ARX Modeling