Abstract:In this paper, a novel adaptive dynamic programming (ADP) algorithm is developed to solve the nearly optimal finite-horizon control problem for a class of deterministic nonaffine nonlinear time-delay systems. The idea is to use ADP technique to obtain the nearly optimal control which makes the optimal performance index function close to the greatest lower bound of all performance index functions within finite time. The proposed algorithm contains two cases with respective different initial iterations. In the first case, there exists control policy which makes arbitrary state of the system reach to zero in one time step. In the second case, there exists a control sequence which makes the system reach to zero in multiple time steps. The state updating is used to determine the optimal state. Convergence analysis of the performance index function is given. Furthermore, the relationship between the iteration steps and the length of the control sequence is presented. Two neural networks are used to approximate the performance index function and compute the optimal control policy for facilitating the implementation of ADP iteration algorithm. At last, two examples are used to demonstrate the effectiveness of the proposed ADP iteration algorithm.

Discrete-Time Impulsive Adaptive Dynamic Programming.

Value Iteration Adaptive Dynamic Programming for Optimal Control of Discrete-Time Nonlinear Systems

Finite-approximation-error-based Discrete-Time Iterative Adaptive Dynamic Programming.

Nearly Finite-Horizon Optimal Control for A Class of Nonaffine Time-Delay Nonlinear Systems Based on Adaptive Dynamic Programming

Model-free Adaptive Dynamic Programming for Optimal Control of Discrete-time Affine Nonlinear System

Local Policy Iteration Adaptive Dynamic Programming for Discrete-Time Nonlinear Systems

Finite Horizon Optimal Control of Non-Linear Discrete-Time Switched Systems Using Adaptive Dynamic Programming with Ε-Error Bound.

An Iterative Adaptive Dynamic Programming Algorithm for Optimal Control of Unknown Discrete-Time Nonlinear Systems with Constrained Inputs.

Analyses For Optimal Control Of Discrete Time-Delay Systems Based On Adp Algorithm With Finite-Horizon Performance Index

Adaptive Dynamic Programming for a Class of Complex-Valued Nonlinear Systems

Multi-Objective Optimal Control for A Class of Nonlinear Time-Delay Systems Via Adaptive Dynamic Programming

An Overview of Research on Adaptive Dynamic Programming

A Novel Stable Value Iteration-Based Approximate Dynamic Programming Algorithm for Discrete-Time Nonlinear Systems

Adaptive dynamic programming-based algorithm for infinite-horizon linear quadratic stochastic optimal control problems

Data-Driven Event-Triggered Adaptive Dynamic Programming Control for Nonlinear Systems with Input Saturation.

Nearly Finite-Horizon Optimal Control for Nonaffine Time-Delay Nonlinear Systems

H<inf>&#x221E;</inf> Control of Unknown Discrete-Time Nonlinear Systems with Control Constraints Using Adaptive Dynamic Programming

Optimal tracking control of a class of nonlinear discrete-time switched systems using adaptive dynamic programming

Discrete-Time Optimal Control Via Local Policy Iteration Adaptive Dynamic Programming

Infinite-time stochastic linear quadratic optimal control for unknown discrete-time systems using adaptive dynamic programming approach

On Iterative Adaptive Dynamic Programming