Abstract:This paper deals with the robust control issues for a class of uncertain nonlinear systems with completely unknown dynamics via a data-driven reinforcement learning method. Firstly, we formulate the optimal regulation control problem for the nominal system, and then, the robust controller for the original uncertain system is designed by adding a constant feedback gain to the optimal controller of the nominal system. Then, this scheme is extended to the optimal tracking control by means of augmented system and discount factor. It is also demonstrated that the proposed robust controller can achieve optimality with a new defined performance index function when there is no control perturbation. It is well known that the nonlinear optimal control problem relies on the solution of Hamilton–Jacobi–Bellman (HJB) equation, which is a nonlinear partial differential equation and impossible to be solved analytically. In order to overcome this difficulty, we introduce a model-based iterative learning algorithm to successively approximate the solution of HJB equation and provide its convergence proof. Subsequently, based on the structure of the model-based approach, a data-driven reinforcement learning method is derived, which only requires the sampling data from real system with different control inputs rather than the accurate mathematical system models. Neural networks (NNs) are utilized to implement this model-free method to approximate the optimal solutions and the least-square approach is employed to minimize the NN approximation residual errors. Finally, two numerical simulation examples are given to illustrate the effectiveness of our proposed method.

Robust Near-optimal Control for Constrained Nonlinear System via Integral Reinforcement Learning

Optimal Control for Constrained Discrete-Time Nonlinear Systems Based on Safe Reinforcement Learning.

Optimal Robust Control of Nonlinear Uncertain System Via Off-Policy Integral Reinforcement Learning

Data-based Robust Adaptive Control for a Class of Unknown Nonlinear Constrained-Input Systems Via Integral Reinforcement Learning

Synchronous Optimal Control Method for Nonlinear Systems with Saturating Actuators and Unknown Dynamics Using Off-Policy Integral Reinforcement Learning

A learning optimal control scheme for robust stabilization of a class of uncertain nonlinear systems

Off-Policy Risk-Sensitive Reinforcement Learning-Based Constrained Robust Optimal Control

Reinforcement-Learning-Based Robust Controller Design for Continuous-Time Uncertain Nonlinear Systems Subject to Input Constraints

Robust Control of Uncertain Linear Systems Based on Reinforcement Learning Principles.

Adaptive Optimal Control For A Class Of Uncertain Systems With Saturating Actuators And External Disturbance Using Integral Reinforcement Learning

Reinforcement Learning for Robust Neuro-Control of Constrained Nonlinear Systems

Reinforcement Learning for Robust Adaptive Control of Partially Unknown Nonlinear Systems Subject to Unmatched Uncertainties

Event-trigger-based Robust Control for Nonlinear Constrained-Input Systems Using Reinforcement Learning Method

An Adaptive Cross Approximation-based Method for Robust Nonlinear Feedback Control Problems

Robust optimal control of the multi‐input systems with unknown disturbance based on adaptive integral reinforcement learning Q‐function

Dynamic Compensator-Based Near-Optimal Control for Unknown Nonaffine Systems Via Integral Reinforcement Learning

Robust Tracking Control with Reinforcement Learning for Nonlinear‐constrained Systems

Robust Reinforcement Learning for Risk-Sensitive Linear Quadratic Gaussian Control

Robust control for a class of nonlinear systems with input constraints based on actor‐critic learning

Data-based robust control for unknown nonlinear systems

Robust control scheme for a class of uncertain nonlinear systems with completely unknown dynamics using data-driven reinforcement learning method.