Abstract:This article solves the robust tracking problem for a type of partially unknown nonlinear systems with asymmetric constrained‐input by utilizing an improved adaptive dynamic programming method based on experience replay technique and critic‐only neural network (NN). Besides, an identifier neural network (INN) is used to identify the unknown part of the system dynamics. This article solves the robust tracking problem (RTP) for a type of partially unknown nonlinear systems with asymmetric constrained‐input by utilizing an improved adaptive dynamic programming (ADP) method based on experience replay (ER) technique and critic‐only neural network (NN). Initially, an identifier neural network (INN) is used to identify the unknown part of the system dynamics. Subsequently, the tracking error and the desired trajectory are used to construct an augmented system, so that the robust tracking problem (RTP) is transformed into a constrained optimal control problem (OCP). It is proved that the designed control policy of OCP can make the tracking error to be uniformly ultimately bounded (UUB). Then, using the framework of ADP and critic‐only NN to solve the derived Hamilton–Jacobi–Bellman equation (HJBE). The NN weight regulation law is partially derived by using gradient descent algorithm (GDA) and then is improved by using the ER technique and the Lyapunov stability theory, which no longer need the conditions of persistence of excitation (PE) and the initial admissible control. Besides, the total system states and NN weights are proved to be closed‐loop stable by utilizing the Lyapunov technique. Finally, through two simulation examples, it is demonstrated that the proposed control scheme is effective.

Online Adaptive Optimal Control Algorithm of Partial Unknown System with Adding Experience Replay and Safety Check

Online Adaptive Optimal Control for Continuous-Time Nonlinear Systems with Completely Unknown Dynamics.

Online Reinforcement Learning-based Neural Network Controller Design for Affine Nonlinear Discrete-time Systems.

Model-free Adaptive Dynamic Programming for Optimal Control of Discrete-time Affine Nonlinear System

Near Optimal Neural Network-based Output Feedback Control of Affine Nonlinear Discrete-Time Systems

Online reinforcement learning control of unknown nonaffine nonlinear discrete time systems

Reinforcement Learning Controller Design for Affine Nonlinear Discrete-Time Systems Using Online Approximators

Data-driven iterative adaptive dynamic programming algorithm for approximate optimal control of unknown nonlinear systems

Online Off-Policy Reinforcement Learning for Optimal Control of Unknown Nonlinear Systems Using Neural Networks

Learning-Based Neural Dynamic Surface Predictive Control for MMC

An Online Algorithm for Solving Feedback Optimal Control Problems with Partial Observations

Online and model-free supplementary learning control based on approximate dynamic programming

Online Adaptive Optimization Algorithm for Semi-Markov Control Processes

State and Input Constrained Output-Feedback Adaptive Optimal Control of Affine Nonlinear Systems

Adaptive Optimal Control for a Class of Continuous-Time Affine Nonlinear Systems with Unknown Internal Dynamics

Experience replay based online adaptive robust tracking control for partially unknown nonlinear systems with asymmetric constrained‐input

Online optimal consensus control of unknown linear multi-agent systems via time-based adaptive dynamic programming

Adaptive optimal control for a class of nonlinear partially uncertain dynamic systems via policy iteration

Model-Free Adaptive Optimal Control for Unknown Nonlinear Multiplayer Nonzero-Sum Game

A neural-network-based online optimal control approach for nonlinear robust decentralized stabilization

Fixed-Time Neuro-Optimal Adaptive Control With Input Saturation for Uncertain Robots