Abstract:This paper deals with the robust control issues for a class of uncertain nonlinear systems with completely unknown dynamics via a data-driven reinforcement learning method. Firstly, we formulate the optimal regulation control problem for the nominal system, and then, the robust controller for the original uncertain system is designed by adding a constant feedback gain to the optimal controller of the nominal system. Then, this scheme is extended to the optimal tracking control by means of augmented system and discount factor. It is also demonstrated that the proposed robust controller can achieve optimality with a new defined performance index function when there is no control perturbation. It is well known that the nonlinear optimal control problem relies on the solution of Hamilton–Jacobi–Bellman (HJB) equation, which is a nonlinear partial differential equation and impossible to be solved analytically. In order to overcome this difficulty, we introduce a model-based iterative learning algorithm to successively approximate the solution of HJB equation and provide its convergence proof. Subsequently, based on the structure of the model-based approach, a data-driven reinforcement learning method is derived, which only requires the sampling data from real system with different control inputs rather than the accurate mathematical system models. Neural networks (NNs) are utilized to implement this model-free method to approximate the optimal solutions and the least-square approach is employed to minimize the NN approximation residual errors. Finally, two numerical simulation examples are given to illustrate the effectiveness of our proposed method.

Data-driven Robust Regulation of Nonlinear Systems with Mismatched Disturbances.

Self-learning Robust Optimal Control for Continuous-Time Nonlinear Systems with Mismatched Disturbances

Data-based robust control for unknown nonlinear systems

Robust control scheme for a class of uncertain nonlinear systems with completely unknown dynamics using data-driven reinforcement learning method.

Robust Adaptive Iterative Learning Control for Discrete‐time Nonlinear Systems with Both Parametric and Nonparametric Uncertainties

Data-based Robust Adaptive Control for a Class of Unknown Nonlinear Constrained-Input Systems Via Integral Reinforcement Learning

Data-based robust optimal control of continuous-time affine nonlinear systems with matched uncertainties

Robust Neurooptimal Control for a Robot Via Adaptive Dynamic Programming

Robust optimal control for a class of nonlinear dynamic systems using single network adaptive dynamic programming

Reinforcement Learning-Based Robust Optimal Tracking Control for Disturbed Nonlinear Systems

Adaptive Dynamic Programming Based Robust Control of Nonlinear Systems with Unmatched Uncertainties

Design of Robust Adaptive Neural Switching Controller for Robotic Manipulators with Uncertainty and Disturbances

Reinforcement Learning for Robust Neuro-Control of Constrained Nonlinear Systems

Robust Adaptive Neural Control of a Class of MIMO Nonlinear Systems

Optimal Robust Control of Nonlinear Uncertain System Via Off-Policy Integral Reinforcement Learning

Robust Adaptive Neural Network Control for a Class of Nonlinear Systems

Robust adaptive neural network optimal control for a class of uncertain nonlinear systems

Data-driven Robust Optimal Control for Nonlinear System with Uncertain Disturbances

Robust stabilization of discrete-time uncertain nonlinear systems using neuro-optimal control strategy

A neural-network-based online optimal control approach for nonlinear robust decentralized stabilization

Robust Control Of Uncertain Nonlinear Systems Based On Adaptive Dynamic Programming