Abstract:This paper deals with the robust control issues for a class of uncertain nonlinear systems with completely unknown dynamics via a data-driven reinforcement learning method. Firstly, we formulate the optimal regulation control problem for the nominal system, and then, the robust controller for the original uncertain system is designed by adding a constant feedback gain to the optimal controller of the nominal system. Then, this scheme is extended to the optimal tracking control by means of augmented system and discount factor. It is also demonstrated that the proposed robust controller can achieve optimality with a new defined performance index function when there is no control perturbation. It is well known that the nonlinear optimal control problem relies on the solution of Hamilton–Jacobi–Bellman (HJB) equation, which is a nonlinear partial differential equation and impossible to be solved analytically. In order to overcome this difficulty, we introduce a model-based iterative learning algorithm to successively approximate the solution of HJB equation and provide its convergence proof. Subsequently, based on the structure of the model-based approach, a data-driven reinforcement learning method is derived, which only requires the sampling data from real system with different control inputs rather than the accurate mathematical system models. Neural networks (NNs) are utilized to implement this model-free method to approximate the optimal solutions and the least-square approach is employed to minimize the NN approximation residual errors. Finally, two numerical simulation examples are given to illustrate the effectiveness of our proposed method.

A learning optimal control scheme for robust stabilization of a class of uncertain nonlinear systems

Neural-network-based robust optimal control design for a class of uncertain nonlinear systems via adaptive dynamic programming

Robust stabilization of discrete-time uncertain nonlinear systems using neuro-optimal control strategy

Policy Iteration Algorithm for Online Design of Robust Control for a Class of Continuous-Time Nonlinear Systems

A neural-network-based online optimal control approach for nonlinear robust decentralized stabilization

Neural-Network-Based Online HJB Solution for Optimal Robust Guaranteed Cost Control of Continuous-Time Uncertain Nonlinear Systems

Robust control scheme for a class of uncertain nonlinear systems with completely unknown dynamics using data-driven reinforcement learning method.

Robust adaptive neural network optimal control for a class of uncertain nonlinear systems

An Approximate Optimal Control Approach for Robust Stabilization of a Class of Discrete-Time Nonlinear Systems with Uncertainties

Adaptive Optimal Robust Control for Uncertain Nonlinear Systems Using Neural Network Approximation in Policy Iteration

Robust optimal control for a class of nonlinear dynamic systems using single network adaptive dynamic programming

An Off‐policy Iteration Algorithm for Robust Stabilization of Constrained‐input Uncertain Nonlinear Systems

Robust Adaptive Iterative Learning Control for Discrete‐time Nonlinear Systems with Both Parametric and Nonparametric Uncertainties

An Adaptive Cross Approximation-based Method for Robust Nonlinear Feedback Control Problems

Adaptive Dynamic Programming Based Robust Control of Nonlinear Systems with Unmatched Uncertainties

Optimal Robust Control of Nonlinear Uncertain System Via Off-Policy Integral Reinforcement Learning

A Novel Self-Learning Optimal Control Approach for Decentralized Guaranteed Cost Control of A Class of Complex Nonlinear Systems

Event-Triggered Robust Optimal Control for Nonlinear Systems With Uncertain Dynamics and Nonzero-equilibrium

Adaptive dynamic programming for infinite horizon optimal robust guaranteed cost control of a class of uncertain nonlinear systems

Off‐policy reinforcement learning algorithm for robust optimal control of uncertain nonlinear systems

Adaptive Critic Learning-Based Robust Control of Systems with Uncertain Dynamics