Abstract:This article addresses the optimal tracking control problem with prescribed performance for uncertain nonlinear systems subject to input constraint and unknown disturbances. First, a fixed‐time monotonic convergence function is introduced to restrain tracking error, and a nonlinear mapping technique is employed to transform the constrained error into an unconstrained variable, then the fixed‐time output tracking issue is boiled down to the boundedness problem of the transformed variable. With the aid of a nonquadratic cost function, the input constraint is encoded into the optimization problem. To solve the unknown disturbances, an auxiliary system and an auxiliary disturbance policy are constructed, and the optimal control problem is formulated as a two‐player zero‐sum game. Moreover, a Hamilton–Jacobi–Isaacs (HJI) equation associated with this nonquadratic zero‐sum game is established to give the optimal control and the worst‐case disturbance policy solution. Subsequently, to avoid using knowledge of the system dynamics, three neural network approximators, namely, actor, critic, and disturbance, which are tuned online and simultaneously for approximating the solution of HJI, are constructed based on the integral reinforcement learning algorithm. Theoretical analysis shows that the reconstructed error system states and the weight estimation errors are semi‐globally uniformly ultimately bounded. Finally, the simulation study further tests the availability of the proposed control strategy.

General value iteration based reinforcement learning for solving optimal tracking control problem of continuous-time affine nonlinear systems.

A Learning-Based Optimal Tracking Controller for Continuous Linear Systems with Unknown Dynamics: Theory and Case Study

Optimal Control for Constrained Discrete-Time Nonlinear Systems Based on Safe Reinforcement Learning.

General value iteration based single network approach for constrained optimal controller design of partially-unknown continuous-time nonlinear systems.

Value Iteration Based Integral Reinforcement Learning Approach for H∞ Controller Design of Continuous-Time Nonlinear Systems

Model-Free Optimal Tracking Design With Evolving Control Strategies via Q-Learning

Data-driven Optimal Tracking Control for a Class of Affine Non-Linear Continuous-Time Systems with Completely Unknown Dynamics

Learning-based adaptive optimal control of linear time-delay systems: A value iteration approach

Optimal control for discrete-time affine non-linear systems using general value iteration

Optimal State Tracking Control for Linear Discrete-time Systems Via Value Iteration

Reinforcement Learning-Based Control for Nonlinear Discrete-Time Systems with Unknown Control Directions and Control Constraints

Iterative Q-learning-based Nonlinear Optimal Tracking Control

A Model-Free Resilient Tracking Control Scheme for Non-Affine Nonlinear Continuous Systems with Uncertainties

Continuous‐time receding‐horizon reinforcement learning and its application to path‐tracking control of autonomous ground vehicles

Event-Triggered H∞ Tracking Control of Nonlinear Systems Via Reinforcement Learning Method.

H∞ Tracking Control for Linear Discrete‐time Systems Via Reinforcement Learning

Linear Quadratic Tracking Control of Unknown Discrete-Time Systems Using Value Iteration Algorithm

Integral reinforcement learning‐based optimal tracking control for uncertain nonlinear systems under input constraint and specified performance constraints

Value Iteration-Based H∞ Controller Design for Continuous-Time Nonlinear Systems Subject to Input Constraints

Reinforcement Learning for Finite-Horizon H∞ Tracking Control of Unknown Discrete Linear Time-Varying System

Robust Tracking Control with Reinforcement Learning for Nonlinear‐constrained Systems