Abstract:This paper discusses the problem of fault-tolerant tracking control for discrete-time nonstrict-feedback nonlinear systems in the presence of stochastic noises and actuator faults. The system is characterized by a discrete-time nonstrict-feedback structure and multiplicative stochastic noise related to the states, which poses a challenge for the design and analysis of the fault-tolerant controller. Moreover, the considered actuator faults include multiplicative and additive faults without prior information. By integrating the properties of the backstepping framework and neural networks, and by introducing an adaptive fault compensation term, a novel fault-tolerant tracking control strategy is proposed. The effects of faults are compensated and the difficulties caused by the system structure are overcome, avoiding the algebraic loop problem and overcoming the causal contradiction. Given specific parameters, the designed fault-tolerant controller can ensure that the tracking error converges to an adjustable region regarding the origin and that all system signals are uniformly bounded concerning the mean-square sense. The simulation examples illustrate the effectiveness of the designed fault-tolerant control method.Note to Practitioners-As system complexity has been increasing, practical systems are often affected by faults when performing tracking control. Fault-tolerant control can provide acceptable robustness and improve system safety. On the one hand, many practical systems are nonlinear, difficult to model mathematically and accurately, and affected by stochastic noises. On the other hand, with digital control, the object is a discrete-time system. In practical applications, the upper bounds of the faults and the noises are often unknown. In this paper, a novel adaptive fault-tolerant control method is proposed for the more general uncertain discrete-time nonlinear systems, i.e., nonstrict-feedback nonlinear systems, with stochastic noises and actuator faults. Neural networks and an adaptive fault compensation term are integrated into the fault-tolerant controller. By adjusting the controller parameters properly, it is ensured that the tracking error converges to a small neighborhood of zero in the event of a fault occurring. In future research, sensor faults, input constraints, optimal control design, and applications in multi-agent systems will be considered.

Auxiliary Input Design for Active Fault Detection via Deep Reinforcement Learning.

An integrated design method for active fault diagnosis and control

Input Design for Active Fault Detection: Reconciling System Control Objectives.

Online Active Fault Detection for Over-Actuated Systems with Prescribed Control Performance

Active fault diagnosis for a class of closed-loop systems via parameter estimation

Active Input Design to Balance Fault Diagnosis and Tracking Control Performance

Reinforcement Learning-Based Control for Nonlinear Discrete-Time Systems with Unknown Control Directions and Control Constraints

Event-Driven Guaranteed Cost Control Design for Nonlinear Systems With Actuator Faults via Reinforcement Learning Algorithm

Reinforcement learning-based decentralized fault tolerant control for constrained interconnected nonlinear systems

Small Fault Detection for a Class of Closed-Loop Systems Via Deterministic Learning.

Deep-learning-based design of active fault-tolerant control for automated manufacturing systems subjected to faulty sensors

A Reinforcement Learning System for Fault Detection and Diagnosis in Mechatronic Systems

Adaptive resilient containment control using reinforcement learning for nonlinear stochastic multi-agent systems under sensor faults

Input Design for Integrated Active Fault Diagnosis and Output Tracking Control.

Residual Integral Inverse Reinforcement Learning for Intelligent Self-Healing Control of Unknown Systems with Actuator Faults

Hybrid Reinforcement Learning for Optimal Control of Non-Linear Switching System

Decentralized Adaptive Output Feedback Fault Detection and Control for Uncertain Nonlinear Interconnected Systems.

Fault detection for a class of strict-feedback systems via deterministic learning

Off-policy Reinforcement Learning-Based Novel Model-Free Minmax Fault-Tolerant Tracking Control for Industrial Processes

Integrating reinforcement learning with deterministic learning for fault diagnosis of nonlinear systems

Adaptive Fault-Tolerant Tracking Control for Discrete-Time Nonstrict-Feedback Nonlinear Systems with Stochastic Noises