Abstract:This paper deals with the robust control issues for a class of uncertain nonlinear systems with completely unknown dynamics via a data-driven reinforcement learning method. Firstly, we formulate the optimal regulation control problem for the nominal system, and then, the robust controller for the original uncertain system is designed by adding a constant feedback gain to the optimal controller of the nominal system. Then, this scheme is extended to the optimal tracking control by means of augmented system and discount factor. It is also demonstrated that the proposed robust controller can achieve optimality with a new defined performance index function when there is no control perturbation. It is well known that the nonlinear optimal control problem relies on the solution of Hamilton–Jacobi–Bellman (HJB) equation, which is a nonlinear partial differential equation and impossible to be solved analytically. In order to overcome this difficulty, we introduce a model-based iterative learning algorithm to successively approximate the solution of HJB equation and provide its convergence proof. Subsequently, based on the structure of the model-based approach, a data-driven reinforcement learning method is derived, which only requires the sampling data from real system with different control inputs rather than the accurate mathematical system models. Neural networks (NNs) are utilized to implement this model-free method to approximate the optimal solutions and the least-square approach is employed to minimize the NN approximation residual errors. Finally, two numerical simulation examples are given to illustrate the effectiveness of our proposed method.

Neural-network-based Control Scheme for a Class of Nonlinear Systems with Actuator Faults Via Data-Driven Reinforcement Learning Method

Adaptive Learning Based Fault Tolerant Control for Uncertain Nonlinear Systems

Data-Driven Optimal Fault-Tolerant Control for Unknown Linear Systems

A Fault-tolerant Controller for Unknown Nonlinear System Based on Neural Networks

Adaptive Neural Fault-Tolerant Control for a Class of Strict-Feedback Nonlinear Systems with Actuator and Sensor Faults.

Adaptive neural fault‐tolerant optimal control for nonlinear uncertain systems with dynamic state constraints

Fault Tolerant Control for Nonlinear Systems Using Sliding Mode and Adaptive Neural Network Estimator.

Adaptive Fault-tolerant Neural Control for Large-scale Systems with Actuator Faults

Fault Tolerant Control for a Class of Nonlinear Systems with Multiple Faults Using Neuro-Dynamic Programming.

Adaptive Dynamic Programming Based Fault Compensation Control for Nonlinear Systems with Actuator Failures

Fault-Tolerant Control for Nonlinear System with Actuator Faults and Disturbances Via Adaptive Dynamic Programming

Neuroadaptive Fault-Tolerant Control for Uncertain Nonlinear Systems with New Time-Varying Constraints on States

Robust control scheme for a class of uncertain nonlinear systems with completely unknown dynamics using data-driven reinforcement learning method.

Neural-network-based Fault-Tolerant Control for Nonlinear Systems Subjected to Faults and Saturations

Event-Driven Guaranteed Cost Control Design for Nonlinear Systems With Actuator Faults via Reinforcement Learning Algorithm

Neuroadaptive Fault-Tolerant Control of Nonlinear Systems under Output Constraints and Actuation Faults.

Dnn Based Fault Tolerant Control of Nonlinear Structural Vibration with Actuator Faults

Neural Network-Based Adaptive Consensus Control for a Class of Nonaffine Nonlinear Multiagent Systems with Actuator Faults.

Neural Network–Based Event-Triggered Adaptive Control Algorithms for Uncertain Nonlinear Systems with Actuator Failures

Neural Network-Based Optimal Fault-Tolerant Control for Interconnected Nonlinear Systems with Actuator Failures.

Finite-time sliding mode fault-tolerant neural network control for nonstrict-feedback nonlinear systems