Abstract:In this study, a novel online adaptive dynamic programming (ADP)-based algorithm is developed for solving the optimal control problem of affine non-linear continuous-time systems with unknown internal dynamics. The present algorithm employs an observer-critic architecture to approximate the Hamilton-Jacobi-Bellman equation. Two neural networks (NNs) are used in this architecture: an NN state observer is constructed to estimate the unknown system dynamics and a critic NN is designed to derive the optimal control instead of typical action-critic dual networks employed in traditional ADP algorithms. Based on the developed architecture, the observer NN and the critic NN are tuned simultaneously. Meanwhile, unlike existing tuning laws for the critic, the newly developed critic update rule not only ensures convergence of the critic to the optimal control but also guarantees stability of the closed-loop system. No initial stabilising control is required, and by using recorded and instantaneous data simultaneously for the adaptation of the critic, the restrictive persistence of excitation condition is relaxed. In addition, Lyapunov direct method is utilised to demonstrate the uniform ultimate boundedness of the weights of the observer NN and the critic NN. Finally, an example is provided to verify the effectiveness of the present approach.

Neural Network Observer-Based Optimal Control For Unknown Nonlinear Systems With Control Constraints

Observer-Based Adaptive Optimized Control for Stochastic Nonlinear Systems with State Constraints

Observer-Based Adaptive Optimized Control for Stochastic Nonlinear Systems With Input and State Constraints

Observer-Based Neuro-Adaptive Optimized Control of Strict-Feedback Nonlinear Systems with State Constraints

Neuro-Optimal Control of Unknown Nonaffine Nonlinear Systems with Saturating Actuators.

Adaptive Dynamic Programming-Based Optimal Control of Unknown Nonaffine Nonlinear Discrete-Time Systems with Proof of Convergence

Data-Based On-Line Optimal Control for Unknown Nonlinear Systems Via Adaptive Dynamic Programming Approach

Adaptive Optimal Control for Unknown Constrained Nonlinear Systems with a Novel Quasi-Model Network

An Iterative Adaptive Dynamic Programming Algorithm for Optimal Control of Unknown Discrete-Time Nonlinear Systems with Constrained Inputs.

Online Approximate Optimal Control for Affine Non-Linear Systems with Unknown Internal Dynamics Using Adaptive Dynamic Programming

An Adaptive Dynamic Programming Algorithm to Solve Optimal Control of Uncertain Nonlinear Systems

Reinforcement Learning for Adaptive Optimal Control of Unknown Continuous-Time Nonlinear Systems with Input Constraints.

Event-Triggered Optimal Nonlinear Systems Control Based on State Observer and Neural Network

Neuro-Control Of Nonlinear Systems With Unknown Input Constraints

Observer-Based Adaptive Neural Network Control for Nonlinear Systems in Nonstrict-Feedback Form.

Adaptive Dynamic Programming Based Event-Triggered Control for Unknown Continuous-Time Nonlinear Systems with Input Constraints

Neural-network-based Approach to Finite-Time Optimal Control for a Class of Unknown Nonlinear Systems

Adaptive Neural Inverse Optimal Control for a Class of Strict Feedback Stochastic Nonlinear Systems

Online Adaptive Optimal Control for Continuous-Time Nonlinear Systems with Completely Unknown Dynamics.

Adaptive Neural Network Observer-Based Fault Tolerant Control for Partially Unknown Nonlinear Systems via Adaptive Dynamic Programming

Observer-Based Adaptive Output Feedback Control for Nonaffine Nonlinear Discrete-Time Systems Using Reinforcement Learning.