Abstract:This article solves the robust tracking problem for a type of partially unknown nonlinear systems with asymmetric constrained‐input by utilizing an improved adaptive dynamic programming method based on experience replay technique and critic‐only neural network (NN). Besides, an identifier neural network (INN) is used to identify the unknown part of the system dynamics. This article solves the robust tracking problem (RTP) for a type of partially unknown nonlinear systems with asymmetric constrained‐input by utilizing an improved adaptive dynamic programming (ADP) method based on experience replay (ER) technique and critic‐only neural network (NN). Initially, an identifier neural network (INN) is used to identify the unknown part of the system dynamics. Subsequently, the tracking error and the desired trajectory are used to construct an augmented system, so that the robust tracking problem (RTP) is transformed into a constrained optimal control problem (OCP). It is proved that the designed control policy of OCP can make the tracking error to be uniformly ultimately bounded (UUB). Then, using the framework of ADP and critic‐only NN to solve the derived Hamilton–Jacobi–Bellman equation (HJBE). The NN weight regulation law is partially derived by using gradient descent algorithm (GDA) and then is improved by using the ER technique and the Lyapunov stability theory, which no longer need the conditions of persistence of excitation (PE) and the initial admissible control. Besides, the total system states and NN weights are proved to be closed‐loop stable by utilizing the Lyapunov technique. Finally, through two simulation examples, it is demonstrated that the proposed control scheme is effective.

Finite horizon optimal tracking control of partially unknown linear continuous-time systems using policy iteration

Neural-network-based finite horizon optimal control for partially unknown linear continuous-time systems

A Learning-Based Optimal Tracking Controller for Continuous Linear Systems with Unknown Dynamics: Theory and Case Study

Finite-horizon Neural Optimal Tracking Control for a Class of Nonlinear Systems with Unknown Dynamics

Reinforcement Learning for Finite-Horizon H∞ Tracking Control of Unknown Discrete Linear Time-Varying System

Adaptive critic-based tracking control of non-affine nonlinear discrete-time systems with unknown dynamics

Linear Quadratic Tracking Control of Unknown Discrete-Time Systems Using Value Iteration Algorithm

Online Off-Policy Reinforcement Learning for Optimal Control of Unknown Nonlinear Systems Using Neural Networks

Online reinforcement learning control of unknown nonaffine nonlinear discrete time systems

Approximate Finite-Horizon Optimal Control with Policy Iteration

Policy-Iteration-Based Finite-Horizon Approximate Dynamic Programming for Continuous-Time Nonlinear Optimal Control

Control of Nonaffine Nonlinear Discrete-Time Systems Using Reinforcement-Learning-Based Linearly Parameterized Neural Networks

Finite-horizon <i>H</i><sub> </sub>tracking control for discrete-time linear systems

Policy Iteration Algorithm for Online Design of Robust Control for a Class of Continuous-Time Nonlinear Systems

Dual-loop iterative optimal control for the finite horizon LQR problem with unknown dynamics

Adaptive Optimal Control for a Class of Continuous-Time Affine Nonlinear Systems with Unknown Internal Dynamics

Policy Iteration Reinforcement Learning Method for Continuous-Time Linear-Quadratic Mean-Field Control Problems

Adaptive optimal control for a class of nonlinear partially uncertain dynamic systems via policy iteration

Robust policy iteration for continuous-time stochastic $H_\infty$ control problem with unknown dynamics

Experience replay based online adaptive robust tracking control for partially unknown nonlinear systems with asymmetric constrained‐input

Neural network-based finite-horizon optimal control of uncertain affine nonlinear discrete-time systems