Abstract:Iterative learning control (ILC) is a kind of effective learning control scheme which is mainly designed to solve the problems in controlling a batch or repetitive process. Although the control performances of ILC systems can improved from batch to batch, it still strongly depends on the repeatability of the process and control target. Reinforcement learning (RL) is another learning based optimization algorithm which can be applied to many complicated decision-making scenarios. Data-driven based RL algorithms have good robustness due to the generalization of the policy neural network, however, it is low-data efficiency in network training. In this paper, for batch process control we propose a new reinforcement learning control (RLC) scheme which is guided by classical iterative leaning control. On the one hand, this RLC scheme has capability to optimize the policy network faster than RL algorithm without guidance, on the other hand, the generalization of deep policy network improves the robustness of the control system. Based on the numerical simulations, the effectiveness of the proposed control scheme is demonstrated by comparing with the conventional reinforcement learning algorithm and the P-type iterative learning control scheme. This paper provides a new way for the application of reinforcement learning algorithm to batch process control.

Iterative Learning Control and It's Application to Batch Process Optimization

Batch Process Iterative Learning Control Based on Wavelet Recurrent Neural Network

Batch-To-Batch Control of Batch Processes Based on Multilayer Recurrent Fuzzy Neural Network

Iterative Learning Model Predictive Control for a Class of Continuous/Batch Processes

Integrated Design Method of A Cascade Iterative Learning Control for the Cascaded Batch/Repetitive Processes

Neural Network Based Iterative Learning Control For Product Qualities In Batch Processes

ILC Based Economic Batch-to-Batch Optimization for Batch Processes

Development and Expectation for Iterative Learning Control

Optimal iterative learning control for end-point product qualities in semi-batch process based on neural network model

ILC Based Economic Optimization for Batch Processes Using Helpful Disturbance Information

Optimal Iterative Learning Control for Batch Processes Based on Linear Time-varying Perturbation Model

Iterative learning control of batch process with input trajectory parameterization

Run-to-run iterative optimization control of batch

Iterative Learning Control (ILC) Guided Reinforcement Learning Control (RLC) Scheme for Batch Processes

Model-Based Iterative Learning Control for Batch Processes Using Generalized Hinging Hyperplanes

Run-to-Run Iterative Optimization Control of Batch Processes Based on Recurrent Neural Networks

A batch-to-batch iterative optimal control strategy based on recurrent neural network models

Optimal Iterative Learning Control for Batch Processes with Model Parameter Variations Using Strong Tracking Filter

An integrated batch-to-batch iterative learning control and within batch control strategy for batch processes

INTEGRATED BATCH-TO-BATCH ITERATIVE LEARNING CONTROL AND WITHIN BATCH CONTROL OF PRODUCT QUALITY FOR BATCH PROCESSES

Product Quality Trajectory Tracking in Batch Processes Using Iterative Learning Control Based on Time-Varying Perturbation Models