Abstract:This paper deals with the robust control issues for a class of uncertain nonlinear systems with completely unknown dynamics via a data-driven reinforcement learning method. Firstly, we formulate the optimal regulation control problem for the nominal system, and then, the robust controller for the original uncertain system is designed by adding a constant feedback gain to the optimal controller of the nominal system. Then, this scheme is extended to the optimal tracking control by means of augmented system and discount factor. It is also demonstrated that the proposed robust controller can achieve optimality with a new defined performance index function when there is no control perturbation. It is well known that the nonlinear optimal control problem relies on the solution of Hamilton–Jacobi–Bellman (HJB) equation, which is a nonlinear partial differential equation and impossible to be solved analytically. In order to overcome this difficulty, we introduce a model-based iterative learning algorithm to successively approximate the solution of HJB equation and provide its convergence proof. Subsequently, based on the structure of the model-based approach, a data-driven reinforcement learning method is derived, which only requires the sampling data from real system with different control inputs rather than the accurate mathematical system models. Neural networks (NNs) are utilized to implement this model-free method to approximate the optimal solutions and the least-square approach is employed to minimize the NN approximation residual errors. Finally, two numerical simulation examples are given to illustrate the effectiveness of our proposed method.

Output-Feedback Robust Control of Uncertain Systems Via Online Data-Driven Learning

Output feedback stabilization for a class of linear time-varying uncertain time-delay systems

Robust Output Feedback Control for a Class of Linear Time-Varying Uncertain Time-Delay Systems

Output‐feedback Robust Control of Systems with Uncertain Dynamics Via Data‐driven Policy Learning

Output feedback robust predictive control based on a class of uncertain fuzzy models

Adaptive Robust Control for Uncertain Systems Via Data-Driven Learning.

Online Output-Feedback Optimal Control of Linear Systems Based on Data-Driven Adaptive Learning

Output-feedback Robust Tracking Control of Uncertain Systems via Adaptive Learning

Robust Adaptive Iterative Learning Control for Discrete‐time Nonlinear Systems with Both Parametric and Nonparametric Uncertainties

Robust Output Feedback Hierarchical Control for A Class of Non-Linear Systems

Robust control scheme for a class of uncertain nonlinear systems with completely unknown dynamics using data-driven reinforcement learning method.

Robust Tracking Control of Uncertain Nonlinear Systems with Adaptive Dynamic Programming

Robust adaptive output feedback control to a class of non-triangular stochastic nonlinear systems

Adaptive Robust H<inf>&#x221E;</inf> Dynamic Output Feedback for Continuous Time-Varying Uncertain Systems

Robust control for a class of nonlinear systems with input constraints based on actor‐critic learning

Robust control of a class of non-affine nonlinear systems by state and output feedback

Robust adaptive output feedback control for uncertain nonlinear systems

Adaptive Critic Learning-Based Robust Control of Systems with Uncertain Dynamics

Adaptive Dynamic Programming Based Robust Control of Nonlinear Systems with Unmatched Uncertainties

Reinforcement Learning‐based Robust Optimal Output Regulation for Constrained Nonlinear Systems with Static and Dynamic Uncertainties

Model-free Nonlinear Robust Control Design Via Online Critic Learning.