Abstract:In this study, a novel online adaptive dynamic programming (ADP)-based algorithm is developed for solving the optimal control problem of affine non-linear continuous-time systems with unknown internal dynamics. The present algorithm employs an observer-critic architecture to approximate the Hamilton-Jacobi-Bellman equation. Two neural networks (NNs) are used in this architecture: an NN state observer is constructed to estimate the unknown system dynamics and a critic NN is designed to derive the optimal control instead of typical action-critic dual networks employed in traditional ADP algorithms. Based on the developed architecture, the observer NN and the critic NN are tuned simultaneously. Meanwhile, unlike existing tuning laws for the critic, the newly developed critic update rule not only ensures convergence of the critic to the optimal control but also guarantees stability of the closed-loop system. No initial stabilising control is required, and by using recorded and instantaneous data simultaneously for the adaptation of the critic, the restrictive persistence of excitation condition is relaxed. In addition, Lyapunov direct method is utilised to demonstrate the uniform ultimate boundedness of the weights of the observer NN and the critic NN. Finally, an example is provided to verify the effectiveness of the present approach.

An Adaptive Dynamic Programming Algorithm to Solve Optimal Control of Uncertain Nonlinear Systems

Online Approximate Optimal Control for Affine Non-Linear Systems with Unknown Internal Dynamics Using Adaptive Dynamic Programming

An Iterative Adaptive Dynamic Programming Algorithm for Optimal Control of Unknown Discrete-Time Nonlinear Systems with Constrained Inputs.

Model-free Adaptive Dynamic Programming for Optimal Control of Discrete-time Affine Nonlinear System

Robust Control Of Uncertain Nonlinear Systems Based On Adaptive Dynamic Programming

Robust adaptive dynamic programming for optimal nonlinear control design

Adaptive Dynamic Programming-Based Optimal Control of Unknown Nonaffine Nonlinear Discrete-Time Systems with Proof of Convergence

Adaptive Dynamic Programming for a Class of Complex-Valued Nonlinear Systems

Online Adaptive Optimal Control for Continuous-Time Nonlinear Systems with Completely Unknown Dynamics.

Multi-objective optimal control for a class of unknown nonlinear systems based on finite-approximation-error ADP algorithm

Data-Based On-Line Optimal Control for Unknown Nonlinear Systems Via Adaptive Dynamic Programming Approach

Data-driven iterative adaptive dynamic programming algorithm for approximate optimal control of unknown nonlinear systems

Adaptive Dynamic Programming for Robust Neural Control of Unknown Continuous-Time Non-Linear Systems

Approximate optimal control for an uncertain robot based on adaptive dynamic programming

Multiobjective Optimal Control for a Class of Unknown Nonlinear Systems Based on Finite-Approximation-Error ADP Algorithm

Approximate optimal tracking control for continuous-time unknown nonlinear systems

Event-Driven Optimal Control For Uncertain Nonlinear Systems With External Disturbance Via Adaptive Dynamic Programming

Data-driven Optimal Control for a Class of Unknown Continuous-Time Nonlinear System Using a Novel ADP Method

Neural-network-based robust optimal control design for a class of uncertain nonlinear systems via adaptive dynamic programming

Adaptive Dynamic Programming for Nonlinear-Constrained H∞ Control

Infinite-time stochastic linear quadratic optimal control for unknown discrete-time systems using adaptive dynamic programming approach