Abstract:This article addresses the optimal tracking control problem with prescribed performance for uncertain nonlinear systems subject to input constraint and unknown disturbances. First, a fixed‐time monotonic convergence function is introduced to restrain tracking error, and a nonlinear mapping technique is employed to transform the constrained error into an unconstrained variable, then the fixed‐time output tracking issue is boiled down to the boundedness problem of the transformed variable. With the aid of a nonquadratic cost function, the input constraint is encoded into the optimization problem. To solve the unknown disturbances, an auxiliary system and an auxiliary disturbance policy are constructed, and the optimal control problem is formulated as a two‐player zero‐sum game. Moreover, a Hamilton–Jacobi–Isaacs (HJI) equation associated with this nonquadratic zero‐sum game is established to give the optimal control and the worst‐case disturbance policy solution. Subsequently, to avoid using knowledge of the system dynamics, three neural network approximators, namely, actor, critic, and disturbance, which are tuned online and simultaneously for approximating the solution of HJI, are constructed based on the integral reinforcement learning algorithm. Theoretical analysis shows that the reconstructed error system states and the weight estimation errors are semi‐globally uniformly ultimately bounded. Finally, the simulation study further tests the availability of the proposed control strategy.

Off-policy integral reinforcement learning optimal tracking control for continuous-time chaotic systems

Reinforcement Learning-Based $\mathcal{h}_{\infty }$ Control of 2-D Markov Jump Roesser Systems with Optimal Disturbance Attenuation

A Learning-Based Optimal Tracking Controller for Continuous Linear Systems with Unknown Dynamics: Theory and Case Study

Operational Optimal Tracking Control for Industrial Multirate Systems Subject to Unknown Disturbances

Reinforcement Learning Tracking Control for Unknown Continuous Dynamic Systems

Integral reinforcement learning‐based optimal tracking control for uncertain nonlinear systems under input constraint and specified performance constraints

H∞$$ {h}_{\infty } $$ Optimal Output Tracking Control for Markov Jump Systems: A Reinforcement Learning‐based Approach

Output Feedback Adaptive Dynamic Programming for Linear H∞ Tracking Control

Reinforcement Learning for Finite-Horizon H∞ Tracking Control of Unknown Discrete Linear Time-Varying System

Optimal Asymptotic Tracking Control for Nonzero-Sum Differential Game Systems with Unknown Drift Dynamics via Integral Reinforcement Learning

Off-Policy Reinforcement Learning for $ H_\infty $ Control Design

Iterative Learning Control Design with High‐order Internal Model for Discrete‐time Nonlinear Systems

Robust policy iteration for continuous-time stochastic $H_\infty$ control problem with unknown dynamics

Data-based neural controls for an unknown continuous-time multi-input system with integral reinforcement

Reinforcement Learning-Based Control for Nonlinear Discrete-Time Systems with Unknown Control Directions and Control Constraints

Robust Near-optimal Control for Constrained Nonlinear System via Integral Reinforcement Learning

Optimal Tracking Control of Nonlinear Multiagent Systems Using Internal Reinforce Q-Learning

Chaos Robust Anti-Control of Nonlinear Continuous Systems with Uncertainties

A New Integral Critic Learning for Optimal Tracking Control with Applications to Boiler‐Turbine Systems

Data-Efficient Off-Policy Learning for Distributed Optimal Tracking Control of HMAS with Unidentified Exosystem Dynamics.

Continuous Robust Tracking Controllers for a Class of Uncertain Nonlinear Dynamical Systems