Abstract:Traditional model-based control methods are often not applicable in industrial processes given the typical situation that model parameters are unknown, coefficient matrices are difficult to obtain, and system states are unpredictable. Accordingly, an output feedback fault-tolerant control method based on zero-sum game theory and off-policy Q-learning is presented in this study, with the aim of achieving smooth operation and good tracking performance for industrial processes that often contain sensor faults and disturbances. The specific steps are as follows. First, a system tracking error is introduced into the system to realize a novel extended model. Second, by establishing a performance index function and combining it with minimax theory, the fault-tolerant tracking control problem is converted into a zero-sum game problem. The Bellman and Riccati equations can be established after analyzing the relationship between the performance index and value functions. Then, the Qfunction is introduced, and an off-policy Q-learning algorithm is combined with the Kronecker product without knowledge of system model parameters to design an optimal controller unbiased to detection noise. Finally, the effectiveness of the algorithm is verified by considering the injection molding process as an example. The experimental results validate that the designed controller demonstrates good control and extends the range of tolerable faults while maintaining good tracking performance.

Zero‐sum game‐based H∞ optimal finite‐time prescribed performance control for nonlinear multiagent systems with actuator faults

Zero-Sum Differential Game-Based Optimal Fault-Tolerant Control for Interconnected Systems with Actuator Faults

Zero-Sum Differential Game-Based Fault-Tolerant Control for a Class of Affine Nonlinear Systems

Adaptive Fuzzy Output-Constrained Control of Uncertain MISO Nonlinear Systems with Actuator Faults

Human-in-the-Loop Consensus Control for Nonlinear Multi-Agent Systems With Actuator Faults

Fault-tolerant control for second-order nonlinear systems with actuator faults via zero-sum differential game

Adaptive optimized consensus control for a class of nonlinear multi-agent systems with asymmetric input saturation constraints and hybrid faults

Finite‐horizon H∞ output fault‐tolerant consensus for multi‐agent systems with switching topology and deception attacks

Data-Driven Optimal Fault-Tolerant Control for Unknown Linear Systems

Adaptive Consensus and Circuital Implementation of a Class of Faulty Multiagent Systems

H∞output Feedback Fault-Tolerant Control of Industrial Processes Based on Zero-Sum Games and Off-Policy Q-learning

Prescribed performance adaptive fault‐tolerant control for nonlinear systems with actuator faults and input dead‐zone

Fault-tolerant prescribed performance control of nonlinear systems with process faults and actuator failures

Output Feedback Consensus Control of Nonlinear Multi-agent System Under Communication Faults and Actuator Faults

Simplified optimized finite-time containment control for a class of multi-agent systems with actuator faults

Optimized adaptive consensus control for multi-agent systems with prescribed performance

Reinforcement learning-based optimal adaptive fuzzy control for nonlinear multi-agent systems with prescribed performance

Adaptive inverse optimal consensus control for uncertain high-order multiagent systems with actuator and sensor failures

Finite‐time Prescribed Performance Adaptive Fuzzy Fault‐tolerant Control for Nonstrict‐feedback Nonlinear Systems

Adaptive Fuzzy Finite-Time Control of Nonlinear Systems With Actuator Faults