Abstract:This paper deals with the robust control issues for a class of uncertain nonlinear systems with completely unknown dynamics via a data-driven reinforcement learning method. Firstly, we formulate the optimal regulation control problem for the nominal system, and then, the robust controller for the original uncertain system is designed by adding a constant feedback gain to the optimal controller of the nominal system. Then, this scheme is extended to the optimal tracking control by means of augmented system and discount factor. It is also demonstrated that the proposed robust controller can achieve optimality with a new defined performance index function when there is no control perturbation. It is well known that the nonlinear optimal control problem relies on the solution of Hamilton–Jacobi–Bellman (HJB) equation, which is a nonlinear partial differential equation and impossible to be solved analytically. In order to overcome this difficulty, we introduce a model-based iterative learning algorithm to successively approximate the solution of HJB equation and provide its convergence proof. Subsequently, based on the structure of the model-based approach, a data-driven reinforcement learning method is derived, which only requires the sampling data from real system with different control inputs rather than the accurate mathematical system models. Neural networks (NNs) are utilized to implement this model-free method to approximate the optimal solutions and the least-square approach is employed to minimize the NN approximation residual errors. Finally, two numerical simulation examples are given to illustrate the effectiveness of our proposed method.

Adaptive Robust Control for Uncertain Systems Via Data-Driven Learning.

Output-Feedback Robust Control of Uncertain Systems Via Online Data-Driven Learning

A Dual Adaptive Robust Control for Nonlinear Systems with Parameter and State Estimation

Adaptive Critic Learning-Based Robust Control of Systems with Uncertain Dynamics

Data-Driven Online Adaptive Optimal Control for Linear Systems with Completely Unknown Dynamics

Output‐feedback Robust Control of Systems with Uncertain Dynamics Via Data‐driven Policy Learning

Robust Tracking Control of Uncertain Nonlinear Systems with Adaptive Dynamic Programming

Robust Adaptive Iterative Learning Control for Discrete‐time Nonlinear Systems with Both Parametric and Nonparametric Uncertainties

Robust control scheme for a class of uncertain nonlinear systems with completely unknown dynamics using data-driven reinforcement learning method.

Data-Driven Robust Control of Discrete-Time Uncertain Linear Systems Via Off-Policy Reinforcement Learning.

Data-based Robust Adaptive Control for a Class of Unknown Nonlinear Constrained-Input Systems Via Integral Reinforcement Learning

Data-Driven Adversarial Online Control for Unknown Linear Systems

Output-feedback Robust Tracking Control of Uncertain Systems via Adaptive Learning

Robust adaptive neural networks with an online learning technique for robot control

A Robust Data-Driven Iterative Control Method for Linear Systems with Bounded Disturbances

Online Data-Driven Adaptive Control for Unknown Linear Time-Varying Systems

Adaptive Dynamic Programming Based Robust Control of Nonlinear Systems with Unmatched Uncertainties

Online adaptive data-driven control for unknown nonlinear systems with constrained-input

Online Output-Feedback Optimal Control of Linear Systems Based on Data-Driven Adaptive Learning

Data-based robust control for unknown nonlinear systems

Online Adaptive Critic Robust Control of Discrete-Time Nonlinear Systems with Unknown Dynamics