Abstract:This paper deals with the robust control issues for a class of uncertain nonlinear systems with completely unknown dynamics via a data-driven reinforcement learning method. Firstly, we formulate the optimal regulation control problem for the nominal system, and then, the robust controller for the original uncertain system is designed by adding a constant feedback gain to the optimal controller of the nominal system. Then, this scheme is extended to the optimal tracking control by means of augmented system and discount factor. It is also demonstrated that the proposed robust controller can achieve optimality with a new defined performance index function when there is no control perturbation. It is well known that the nonlinear optimal control problem relies on the solution of Hamilton–Jacobi–Bellman (HJB) equation, which is a nonlinear partial differential equation and impossible to be solved analytically. In order to overcome this difficulty, we introduce a model-based iterative learning algorithm to successively approximate the solution of HJB equation and provide its convergence proof. Subsequently, based on the structure of the model-based approach, a data-driven reinforcement learning method is derived, which only requires the sampling data from real system with different control inputs rather than the accurate mathematical system models. Neural networks (NNs) are utilized to implement this model-free method to approximate the optimal solutions and the least-square approach is employed to minimize the NN approximation residual errors. Finally, two numerical simulation examples are given to illustrate the effectiveness of our proposed method.

Robust stabilization of discrete-time uncertain nonlinear systems using neuro-optimal control strategy

Robust Stabilization for a Class of Nonlinear Networked Control Systems

A neural-network-based online optimal control approach for nonlinear robust decentralized stabilization

A learning optimal control scheme for robust stabilization of a class of uncertain nonlinear systems

An Approximate Optimal Control Approach for Robust Stabilization of a Class of Discrete-Time Nonlinear Systems with Uncertainties

Neural-network-based robust optimal control design for a class of uncertain nonlinear systems via adaptive dynamic programming

Robust optimal control for a class of nonlinear dynamic systems using single network adaptive dynamic programming

Neural Network Algorithm for Stabilizing Control of Robustness in Systems

Event-Triggered Robust Optimal Control for Nonlinear Systems With Uncertain Dynamics and Nonzero-equilibrium

Robust adaptive neural network optimal control for a class of uncertain nonlinear systems

Robust Neurooptimal Control for a Robot Via Adaptive Dynamic Programming

Adaptive Dynamic Programming Based Robust Control of Nonlinear Systems with Unmatched Uncertainties

Robust Control Of Uncertain Nonlinear Systems Based On Adaptive Dynamic Programming

Robust Backstepping Stabilization Control for Uncertain Nonlinear Differential-Algebraic Equations Subsystems Based-on Artificial Neural Networks

Global robust stabilizing control for a dynamic neural network system

Robust Adaptive Neural Network Control for a Class of Nonlinear Systems

Neural-Network-Based Online HJB Solution for Optimal Robust Guaranteed Cost Control of Continuous-Time Uncertain Nonlinear Systems

Adaptive Optimal Robust Control for Uncertain Nonlinear Systems Using Neural Network Approximation in Policy Iteration

Robust H∞ Optimal Control for a Nonlinear Uncertain System

Robust control scheme for a class of uncertain nonlinear systems with completely unknown dynamics using data-driven reinforcement learning method.

Adaptive Neural Inverse Optimal Control for a Class of Strict Feedback Stochastic Nonlinear Systems