Abstract:In this paper, a value-iteration based heuristic dynamic programming (HDP) algorithm is developed to solve the optimal control for the continuous time affine nonlinear systems. First, a rigorous convergence proof of the HDP algorithm is given. Second, stability issues of the HDP algorithm for nonlinear systems are investigated. It is commonly believed that the main drawback of the HDP algorithm is that only the limit function of the iterative control sequence is proved to be stabilized, thus infinite iterations are executed. To confront this problem, we present a novel stability result for the HDP algorithm, which indicates that the resulting iterative control laws after finite iterations can guarantee the closed-loop stability. A similar stability result is also obtained for the discrete time nonlinear systems. Therefore, the practicality of the HDP algorithm is greatly improved. Single neural network (NN) structure is employed to implement the algorithm. It should be pointed that the algorithm can be implemented without knowing the internal dynamics of the systems. Finally, two numerical examples are given to demonstrate the effectiveness of the developed methods.

2-D Analysis of an Iterative Algorithm of Optimal Control for Nonlinear Large-Scale System

2-D Analysis of an Iterative Algorithm for the Optimal Control of the Discrete Nolinear System

2-D Analysis and Design of Iterative Controller Based on Influence Function

Stability analysis of heuristic dynamic programming algorithm for nonlinear systems.

Optimal Control Of A Class Of Non-Linear Discrete-Continuous Hybrid Systems

Optimal Control for Nonlinear Interconnected Large-scale Systems: A Successive Approximation Approach

Convergence Analysis in Sense of Lebesgue- P Norm of Decentralized Non-Repetitive Iterative Learning Control for Linear Large-Scale Systems

Hierarchical Control of a Class of High-dimensional Linear Systems

The Iterative Learning Control and Convergence Analysis for Nonlinear Industrial Process Control Systems

Optimal Iterative Learning Control for Nonlinear Discrete-Time Systems

An Iterative Adaptive Dynamic Programming Algorithm for Optimal Control of Unknown Discrete-Time Nonlinear Systems with Constrained Inputs.

Further Results on Iterative Learning Control with Convergence Conditions for Linear Time-Variant Discrete Systems

Design of the interfaces using approximate simulation and feedback linearization

The Finite-Horizon Optimal Control for a Class of Time-Delay Affine Nonlinear System

Hierarchical Control of a Class of Uncertain Linear Systems.

Policy Iteration-Based Optimal Control Design for Nonlinear Descriptor Systems

From Two-Dimensional Linear Quadratic Optimal Control to Iterative Learning Control. Paper 1. Two-Dimensional Linear Quadratic Optimal Controls and System Analysis

Direct Iterative Algorithm to Solve the Extended Levine-Athans Equations

The Iterative Learning Control for Dynamics in Steady-state Hierarchical Optimization of Nonlinear Large-scale Industrial Processes

Convergence Issue Of Non-Repetitive Iterative Learning Controllers For Large-Scale Systems

Iterative Learning Controllers for Discrete-Time Large-Scale Systems to Track Trajectories with Distinct Magnitudes.