Abstract:As the large-scale integration of renewable energy into the power grid, coal-fired power units have to undertake the task of load-frequency regulation, the optimization control of the coal-fired power units is becoming increasingly important. Reinforcement learning is being used for optimization control of the process increasingly but may encounter high learning costs. In this paper, a process model-assisted optimization control framework called PMA-OC is proposed to achieve the optimization control of coal-fired power unit. In this framework, a low-precision process model developed by process operation knowledge is employed to achieve the initial control based on model predictive control algorithm (MPC) and improve the dynamic characteristics of the coordinated control system. Then the deep reinforcement learning algorithm (DRL) is utilized to improve the initial control continuously, through constantly interacting with the improved process. With the full mining of process knowledge from the power unit, the improved process offers the better training samples for DRL, reduces the learning complexity of DRL, and strengthens the learning efficiency of DRL. Finally, the proposed control framework is employed to achieve the optimization control of the coordinated control system, and simulation results indicate that the proposed control framework outperforms the existing standalone MPC and DRL methods in terms of anti-interference ability, dynamic response time, and performs well control capability. Note to Practitioners—The flexible and stable operation of coal-fired power units is of great significance to the peak load regulation and supply guarantee of the power grid. For practitioners of the coal-fired power unit, this paper proposes a process model-assisted optimization control framework to promote the process knowledge utilization. In this framework, process knowledge is used to implement preliminary control on coal-fired power units to reduce the complex dynamic characteristics of coal-fired power units. Then, the reinforcement learning algorithm is used to continuously improve the control performance of coal-fired power units by interacting with the improved process. Finally, the effectiveness of the proposed method is verified by a supercritical unit. Although the proposed method is applied to the optimal control of coal-fired power units, its ideas can be used for the reference in other complex industrial processes.

Optimization of Tobacco Drying Process Control Based on Reinforcement Learning

Design of an intelligent controller for a grain dryer: A support vector machines for regression inverse model proportional–integral–derivative controller

An adaptive optimization method toward batch-wise variable set point of outlet moisture content for the tobacco drying process

Tobacco leaf redrying System Control based on Predictive Auto-Coupling PID

Adaptive Online Learning for System Identification and In-Advance Optimization under Long Feedback Delay and Concept Drift in Cigarette Production

Enhancing prior-knowledge-based control with deep attention neural network for outlet moisture content of cut-tobacco

A Reinforcement Learning-Based Temperature Control of Fluidized Bed Reactor in Gas-Phase Polyethylene Process

Accelerating Reinforcement Learning with Local Data Enhancement for Process Control

Double-Loop-Optimization-Based Joint Parameter Tuning for Dynamic Matrix Control With Validation in Intelligent Cigarette Drying Process

Two-Layered Model Predictive Control Strategy of the Cut Tobacco Drying Process

Deep-Learning-Based Model Predictive Control of an Industrial-Scale Multistate Counter-Flow Paddy Drying Process

TD3 Algorithm of Dynamic Classification Replay Buffer Based PID Parameter Optimization

Simulation of Heat and Mass Transfer of Cut Tobacco in a Batch Rotary Dryer by Multi-Objective Optimization

Deep Reinforcement Learning based Optimal Control of Hot Water Systems

Analysis of energy consumption of tobacco drying process based on industrial big data

Development of AI-based process controller of sour water treatment unit using deep reinforcement learning

Design of an Optimal Scheduling Control System for Smart Manufacturing Processes in Tobacco Industry

[Methodology for adaptive decision--making research on manufacturing process of traditional Chinese medicine based on deep reinforcement learning].

Optimizing olefin purification: An artificial intelligence-based process-conscious PI controller tuning for double dividing wall column distillation

Process Model-Assisted Optimization Control Method Based on Model Predictive Control and Deep Reinforcement Learning for Coordinated Control System in Coal-Fired Power Unit

Evolution of control strategies toward Intelligent drying