Abstract:This article solves the robust tracking problem for a type of partially unknown nonlinear systems with asymmetric constrained‐input by utilizing an improved adaptive dynamic programming method based on experience replay technique and critic‐only neural network (NN). Besides, an identifier neural network (INN) is used to identify the unknown part of the system dynamics. This article solves the robust tracking problem (RTP) for a type of partially unknown nonlinear systems with asymmetric constrained‐input by utilizing an improved adaptive dynamic programming (ADP) method based on experience replay (ER) technique and critic‐only neural network (NN). Initially, an identifier neural network (INN) is used to identify the unknown part of the system dynamics. Subsequently, the tracking error and the desired trajectory are used to construct an augmented system, so that the robust tracking problem (RTP) is transformed into a constrained optimal control problem (OCP). It is proved that the designed control policy of OCP can make the tracking error to be uniformly ultimately bounded (UUB). Then, using the framework of ADP and critic‐only NN to solve the derived Hamilton–Jacobi–Bellman equation (HJBE). The NN weight regulation law is partially derived by using gradient descent algorithm (GDA) and then is improved by using the ER technique and the Lyapunov stability theory, which no longer need the conditions of persistence of excitation (PE) and the initial admissible control. Besides, the total system states and NN weights are proved to be closed‐loop stable by utilizing the Lyapunov technique. Finally, through two simulation examples, it is demonstrated that the proposed control scheme is effective.

Optimal Robust Control of Nonlinear Systems with Unknown Dynamics via NN Learning with Relaxed Excitation

Reinforcement Learning-Based Control for Nonlinear Discrete-Time Systems with Unknown Control Directions and Control Constraints

Online Reinforcement Learning-based Neural Network Controller Design for Affine Nonlinear Discrete-time Systems.

Online reinforcement learning control of unknown nonaffine nonlinear discrete time systems

Adaptive optimal control of affine nonlinear systems via identifier-critic neural network approximation with relaxed PE conditions

Reinforcement Learning-Based Control for a Class of Nonlinear Systems with Unknown Control Directions

Control of Nonaffine Nonlinear Discrete-Time Systems Using Reinforcement-Learning-Based Linearly Parameterized Neural Networks

NN/RISE-based asymptotic tracking control of uncertain nonlinear systems

Adaptive Neural Network Control of Nonlinear Systems with Unknown Dynamics

Near Optimal Neural Network-based Output Feedback Control of Affine Nonlinear Discrete-Time Systems

Online Adaptive Optimal Control for Continuous-Time Nonlinear Systems with Completely Unknown Dynamics.

Neural Network Observer-Based Optimal Control For Unknown Nonlinear Systems With Control Constraints

Adaptive critic-based tracking control of non-affine nonlinear discrete-time systems with unknown dynamics

NN-based asymptotic tracking control for a class of strict-feedback uncertain nonlinear systems with output constraints

Observer-Based Adaptive Optimized Control for Stochastic Nonlinear Systems With Input and State Constraints

Neuro-learning-based adaptive control for state-constrained strict-feedback systems with unknown control direction

Neural network-based adaptive robust control of a class of nonlinear systems in normal form

Neural Network Adaptive Robust Control of Nonlinear Systems in Semi-Strict Feedback Form

Experience replay based online adaptive robust tracking control for partially unknown nonlinear systems with asymmetric constrained‐input

Stable Neuro-Adaptive Control For Robot With Unknown Dynamics

NN-Based Reinforcement Learning Optimal Control for Inequality-Constrained Nonlinear Discrete-Time Systems With Disturbances