Abstract:Traditional model-based control methods are often not applicable in industrial processes given the typical situation that model parameters are unknown, coefficient matrices are difficult to obtain, and system states are unpredictable. Accordingly, an output feedback fault-tolerant control method based on zero-sum game theory and off-policy Q-learning is presented in this study, with the aim of achieving smooth operation and good tracking performance for industrial processes that often contain sensor faults and disturbances. The specific steps are as follows. First, a system tracking error is introduced into the system to realize a novel extended model. Second, by establishing a performance index function and combining it with minimax theory, the fault-tolerant tracking control problem is converted into a zero-sum game problem. The Bellman and Riccati equations can be established after analyzing the relationship between the performance index and value functions. Then, the Qfunction is introduced, and an off-policy Q-learning algorithm is combined with the Kronecker product without knowledge of system model parameters to design an optimal controller unbiased to detection noise. Finally, the effectiveness of the algorithm is verified by considering the injection molding process as an example. The experimental results validate that the designed controller demonstrates good control and extends the range of tolerable faults while maintaining good tracking performance.

Iterative Learning Control for Saturated Industrial Process Control Systems with Dead Zone

Iterative Learning Model Predictive Control for a Class of Continuous/Batch Processes

Iterative learning control of linear distributed parameter systems-frequency domain design and analysis

Integrated Design Method of A Cascade Iterative Learning Control for the Cascaded Batch/Repetitive Processes

A Closed-Loop Particle Swarm Optimizer for Multivariable Process Controller Design

Iterative learning control of inhomogeneous distributed parameter systems - frequency domain design and analysis.

AN OPEN-CLOSED-LOOP PI-TYPE ITERATIVE LEARNING CONTROL SCHEME FOR DISCRETE NONLINEAR TIME-VARYING SYSTEMS AND ITS CONVERGENCE

An Iteration-Varying Dead-Zone Based Robust Adaptive Ilc For Discrete-Time Nonlinear Systems With Uncertainties

Reinforcement-Learning-Based Tracking Control of Waste Water Treatment Process under Realistic System Conditions and Control Performance Requirements

A High-Order Internal Model Based Iterative Learning Control Scheme for Discrete Linear Time-Varying Systems

Pseudo Feedforward Dynamic Matrix Control Algorithm for Desired Closed-Loop Performance in MPC Systems

Discrete-Time Adaptive Iterative Learning Control for High-Order Nonlinear Systems with Unknown Control Directions

Optimal iterative learning PI controller for SISO and MIMO processes with machine learning validation for performance prediction

Iterative Learning Control Design with High‐order Internal Model for Discrete‐time Nonlinear Systems

Robust Adaptive Iterative Learning Control for Discrete‐time Nonlinear Systems with Both Parametric and Nonparametric Uncertainties

Robust Iterative Learning Control with Applications to Injection Molding Process

Robust Iterative Learning Control for Multi-Phase Batch Processes: an Average Dwell-Time Method with 2D Convergence Indexes

Adaptive Fuzzy Iterative Learning Control for Systems with Saturated Inputs and Unknown Control Directions

H∞output Feedback Fault-Tolerant Control of Industrial Processes Based on Zero-Sum Games and Off-Policy Q-learning

Design and Analysis of Integrated Predictive Iterative Learning Control for Batch Process Based on Two-Dimensional System Theory

Sequential Quadratic Programming-based Iterative Learning Control for Nonlinear Systems