Abstract:In this paper, the robust optimal control of continuous-time affine nonlinear systems with matched uncertainties is investigated by using a data-based integral policy iteration approach. It is a natural extension of the traditional optimal control design, under the framework of adaptive dynamic programming (ADP) method, to robust optimal control of nonlinear systems with matched uncertainties. In theoretical aspect, by increasing a feedback gain to the optimal controller of the nominal system, the robust controller of the matched uncertain system is obtained, which also achieves optimality with a newly well-defined cost function. When regarding the implementation, the data-based integral policy iteration algorithm is used to solve the Hamilton–Jacobi–Bellman equation corresponding to the nominal system with completely unknown dynamics information. Then, the actor-critic technique based on neural networks and least squares implementation method are employed to facilitate deriving the optimal control law iteratively, so that the closed-form expression of the robust optimal controller is available. Additionally, two simulation examples with application backgrounds are presented to illustrate the effectiveness of the established robust optimal control scheme. In summary, it is important to note that the result developed in this paper broadens the application scope of ADP-based optimal control approach to more general nonlinear systems possessing dynamical uncertainties.

Adaptive Output-Feedback Optimal Control for Continuous-Time Linear Systems Based on Adaptive Dynamic Programming Approach

Robust ADP Design for Continuous-Time Nonlinear Systems with Output Constraints

Output information-based intermittent optimal control for continuous-time nonlinear systems with unmatched uncertainties via adaptive dynamic programming

Optimal dynamic output feedback control of unknown linear continuous-time systems by adaptive dynamic programming

An Iterative Adaptive Dynamic Programming Algorithm for Optimal Control of Unknown Discrete-Time Nonlinear Systems with Constrained Inputs.

Model-free Adaptive Dynamic Programming for Optimal Control of Discrete-time Affine Nonlinear System

An Adaptive Dynamic Programming Algorithm to Solve Optimal Control of Uncertain Nonlinear Systems

Robust adaptive dynamic programming for optimal nonlinear control design

Output Constrained Adaptive Dynamic Programming For Continuous-Time Nonlinear Systems

Optimal Control for a Class of Complex Singular System Based on Adaptive Dynamic Programming

Optimal Output Regulation for Unknown Continuous-Time Linear Systems by Internal Model and Adaptive Dynamic Programming

Data-based robust optimal control of continuous-time affine nonlinear systems with matched uncertainties

Model-free Optimal Controller Design for Continuous-Time Nonlinear Systems by Adaptive Dynamic Programming Based on a Precompensator.

Data‐based robust optimal control of discrete‐time systems with uncertainties via adaptive dynamic programming

ADP-Based Optimal Control of Linear Singularly Perturbed Systems With Uncertain Dynamics: A Two-Stage Value Iteration Method

Online Approximate Optimal Control for Affine Non-Linear Systems with Unknown Internal Dynamics Using Adaptive Dynamic Programming

Adaptive Dynamic Programming and Adaptive Optimal Output Regulation of Linear Systems

Adaptive Dynamic Programming for Robust Neural Control of Unknown Continuous-Time Non-Linear Systems

Adaptive dynamic programming-based optimal control for nonlinear state constrained systems with input delay

Robust Optimal Tracking Control for Linear Systems via Adaptive Dynamic Programming method

Adaptive Dynamic Programming and Optimal Stabilization for Linear Systems with Time-Varying Uncertainty