Abstract:In this paper, the robust optimal control of continuous-time affine nonlinear systems with matched uncertainties is investigated by using a data-based integral policy iteration approach. It is a natural extension of the traditional optimal control design, under the framework of adaptive dynamic programming (ADP) method, to robust optimal control of nonlinear systems with matched uncertainties. In theoretical aspect, by increasing a feedback gain to the optimal controller of the nominal system, the robust controller of the matched uncertain system is obtained, which also achieves optimality with a newly well-defined cost function. When regarding the implementation, the data-based integral policy iteration algorithm is used to solve the Hamilton–Jacobi–Bellman equation corresponding to the nominal system with completely unknown dynamics information. Then, the actor-critic technique based on neural networks and least squares implementation method are employed to facilitate deriving the optimal control law iteratively, so that the closed-form expression of the robust optimal controller is available. Additionally, two simulation examples with application backgrounds are presented to illustrate the effectiveness of the established robust optimal control scheme. In summary, it is important to note that the result developed in this paper broadens the application scope of ADP-based optimal control approach to more general nonlinear systems possessing dynamical uncertainties.

Optimal Robust Control of Nonlinear Uncertain System Via Off-Policy Integral Reinforcement Learning

Optimal Control for Constrained Discrete-Time Nonlinear Systems Based on Safe Reinforcement Learning.

Off‐policy reinforcement learning algorithm for robust optimal control of uncertain nonlinear systems

Off-Policy Risk-Sensitive Reinforcement Learning-Based Constrained Robust Optimal Control

Data-based robust optimal control of continuous-time affine nonlinear systems with matched uncertainties

Robust Near-optimal Control for Constrained Nonlinear System via Integral Reinforcement Learning

Data-based robust control for unknown nonlinear systems

A learning optimal control scheme for robust stabilization of a class of uncertain nonlinear systems

Robust Control for Affine Nonlinear Systems under the Reinforcement Learning Framework

Online Reinforcement Learning-based Neural Network Controller Design for Affine Nonlinear Discrete-time Systems.

Event-Triggered Robust Optimal Control for Nonlinear Systems With Uncertain Dynamics and Nonzero-equilibrium

Robust Reinforcement Learning for Risk-Sensitive Linear Quadratic Gaussian Control

Near Optimal Neural Network-based Output Feedback Control of Affine Nonlinear Discrete-Time Systems

Reinforcement Learning-Based Control for Nonlinear Discrete-Time Systems with Unknown Control Directions and Control Constraints

Neural-network-based robust optimal control design for a class of uncertain nonlinear systems via adaptive dynamic programming

Robust Adaptive Iterative Learning Control for Discrete‐time Nonlinear Systems with Both Parametric and Nonparametric Uncertainties

NN Adaptive Optimal Tracking Control for a Class of Uncertain Nonstrict Feedback Nonlinear Systems

Robust optimal control for a class of nonlinear dynamic systems using single network adaptive dynamic programming

Robust control for a class of nonlinear systems with input constraints based on actor‐critic learning

Reinforcement learning-based optimal control of uncertain nonlinear systems

Robust Neurooptimal Control for a Robot Via Adaptive Dynamic Programming