Abstract:Optimal iterative learning control (OILC) has been recognized as an excellent model-based means for regulating batch process with abundant successful applications reported in the past decades but also received considerable criticisms for its poor robustness against model mismatch that is common for many industrial situations. Despite numerous attempts to address the issue, many of them are still not able to yield satisfactory control performance particularly in the presence of a possible combination of time-varying uncertainties and conservatively designed controllers, which may compromise the learning mechanism, hence rendering the robustness issue of OILC far from well explored. This article intends to investigate the aforementioned issue by proposing a new OILC method resting upon the minimization of a dynamic upper bound on tracking error which is distilled from better exploitation of the time variation of uncertainties. We also show that the problem can be formulated in the framework of convex–concave game that can be efficiently solved by a subgradient method with an excellent balance of optimality and computation time. Such a formulation enables us to gain: 1) guaranteed monotonic convergence on tracking error; 2) remarkably reduced conservatism on controller synthesis; and 3) controllable computation complexity. It is further shown that the proposed method is capable of handling nonlinearity, for example Volterra system, a classic representation of nonlinear process. The efficacy of the method is verified by numerical experiments on a continuous stirred tank reactor model.

New Methods for Optimal Operational Control of Industrial Processes Using Reinforcement Learning on Two Time Scales

Operational Optimal Tracking Control for Industrial Multirate Systems Subject to Unknown Disturbances

Off-Policy Reinforcement Learning: Optimal Operational Control for Two-Time-Scale Industrial Processes.

Reinforcement Learning-Based Composite Optimal Operational Control of Industrial Systems with Multiple Unit Devices

Optimal Control for Constrained Discrete-Time Nonlinear Systems Based on Safe Reinforcement Learning.

Multi-Rate Layered Operational Optimal Control for Large-Scale Industrial Processes

Optimal Operational Control for Industrial Processes Based on Q-learning Method

Reinforcement learning for optimal tracking of large-scale systems with multitime scales

Data-driven operational optimization control of industrial processes

Off-Policy Reinforcement Learning for Tracking in Continuous-Time Systems on Two Time Scales

Optimal Iterative Learning Control for Batch Processes in the Presence of Time-Varying Dynamics

Learning-based optimal control of linear time-varying systems over large time intervals

Data-Driven Flotation Industrial Process Operational Optimal Control Based on Reinforcement Learning.

Q-Learning-Based Multi-Rate Optimal Control for Process Industries

Model-Based Cross-Scale Reinforcement Learning Optimal Control

Reinforcement Learning Based Optimal Control of Linear Singularly Perturbed Systems

Dual-Rate Operational Optimal Control for Flotation Industrial Process With Unknown Operational Model

Data-Driven Solutions to Mixed $h_{2}/h_{\infty}$ Control: A Hamilton-Inequality-Driven Reinforcement Learning Approach.

Human operator decision support for highly transient industrial processes: a reinforcement learning approach

Data-Driven Near-Optimal Control of Nonlinear Systems Over Finite Horizon

Integrating process design and control using reinforcement learning