Abstract:In this study, a novel online adaptive dynamic programming (ADP)-based algorithm is developed for solving the optimal control problem of affine non-linear continuous-time systems with unknown internal dynamics. The present algorithm employs an observer-critic architecture to approximate the Hamilton-Jacobi-Bellman equation. Two neural networks (NNs) are used in this architecture: an NN state observer is constructed to estimate the unknown system dynamics and a critic NN is designed to derive the optimal control instead of typical action-critic dual networks employed in traditional ADP algorithms. Based on the developed architecture, the observer NN and the critic NN are tuned simultaneously. Meanwhile, unlike existing tuning laws for the critic, the newly developed critic update rule not only ensures convergence of the critic to the optimal control but also guarantees stability of the closed-loop system. No initial stabilising control is required, and by using recorded and instantaneous data simultaneously for the adaptation of the critic, the restrictive persistence of excitation condition is relaxed. In addition, Lyapunov direct method is utilised to demonstrate the uniform ultimate boundedness of the weights of the observer NN and the critic NN. Finally, an example is provided to verify the effectiveness of the present approach.

Adaptive Dynamic Programming for Robust Neural Control of Unknown Continuous-Time Non-Linear Systems

Robust adaptive dynamic programming for optimal nonlinear control design

Robust Tracking Control of Uncertain Nonlinear Systems with Adaptive Dynamic Programming

Robust ADP Design for Continuous-Time Nonlinear Systems with Output Constraints

Robust Control Of Uncertain Nonlinear Systems Based On Adaptive Dynamic Programming

Online Adaptive Optimal Control for Continuous-Time Nonlinear Systems with Completely Unknown Dynamics.

Online Approximate Optimal Control for Affine Non-Linear Systems with Unknown Internal Dynamics Using Adaptive Dynamic Programming

Data-Based On-Line Optimal Control for Unknown Nonlinear Systems Via Adaptive Dynamic Programming Approach

An Iterative Adaptive Dynamic Programming Algorithm for Optimal Control of Unknown Discrete-Time Nonlinear Systems with Constrained Inputs.

An Adaptive Dynamic Programming Algorithm to Solve Optimal Control of Uncertain Nonlinear Systems

Adaptive Dynamic Programming Based Robust Control of Nonlinear Systems with Unmatched Uncertainties

Adaptive Dynamic Programming-Based Optimal Control of Unknown Nonaffine Nonlinear Discrete-Time Systems with Proof of Convergence

Adaptive Dynamic Programming Based Event-Triggered Control for Unknown Continuous-Time Nonlinear Systems with Input Constraints

Neural-network-based robust optimal control design for a class of uncertain nonlinear systems via adaptive dynamic programming

Data-driven Optimal Control for a Class of Unknown Continuous-Time Nonlinear System Using a Novel ADP Method

ADP-Based Model Reference Adaptive Control Design for Unknown Discrete-Time Nonlinear Systems

Adaptive Optimal Control for Unknown Constrained Nonlinear Systems with a Novel Quasi-Model Network

Event-Triggered Adaptive Dynamic Programming for Unmatched Uncertain Nonlinear Continuous-Time Systems

Adaptive critic design-based robust neural network control for nonlinear distributed parameter systems with unknown dynamics.

Robust Adaptive Neural Network Control for a Class of Nonlinear Systems

Robust Neurooptimal Control for a Robot Via Adaptive Dynamic Programming