Abstract:This article addresses the optimal tracking control problem with prescribed performance for uncertain nonlinear systems subject to input constraint and unknown disturbances. First, a fixed‐time monotonic convergence function is introduced to restrain tracking error, and a nonlinear mapping technique is employed to transform the constrained error into an unconstrained variable, then the fixed‐time output tracking issue is boiled down to the boundedness problem of the transformed variable. With the aid of a nonquadratic cost function, the input constraint is encoded into the optimization problem. To solve the unknown disturbances, an auxiliary system and an auxiliary disturbance policy are constructed, and the optimal control problem is formulated as a two‐player zero‐sum game. Moreover, a Hamilton–Jacobi–Isaacs (HJI) equation associated with this nonquadratic zero‐sum game is established to give the optimal control and the worst‐case disturbance policy solution. Subsequently, to avoid using knowledge of the system dynamics, three neural network approximators, namely, actor, critic, and disturbance, which are tuned online and simultaneously for approximating the solution of HJI, are constructed based on the integral reinforcement learning algorithm. Theoretical analysis shows that the reconstructed error system states and the weight estimation errors are semi‐globally uniformly ultimately bounded. Finally, the simulation study further tests the availability of the proposed control strategy.

Reinforcement Learning and Optimal Setpoint Tracking Control of Linear Systems with External Disturbances

Operational Optimal Tracking Control for Industrial Multirate Systems Subject to Unknown Disturbances

A Learning-Based Optimal Tracking Controller for Continuous Linear Systems with Unknown Dynamics: Theory and Case Study

Direct Data-Driven Optimal Set-Point Tracking Control of Linear Discrete-Time Systems

Linear Quadratic Tracking Control of Unknown Systems: A Two-Phase Reinforcement Learning Method.

Reinforcement Learning-Based Robust Optimal Tracking Control for Disturbed Nonlinear Systems

An Approximate Neuro-Optimal Solution of Discounted Guaranteed Cost Control Design

Output-feedback Robust Tracking Control of Uncertain Systems via Adaptive Learning

Approximate Optimal Tracking Control For A Class Of Nonlinear Systems With Disturbances

Optimal Output Tracking Control for Continuous Linear Time-Invariable Systems with Control Delays and Sinusoidal Disturbance

Reinforcement Learning Based Data-driven Optimal Control Strategy for Systems with Disturbance

Approximate optimal tracking control for nonlinear time-delay systems under persistent disturbances

Optimal H∞ Tracking Control of Nonlinear Systems with Zero-Equilibrium-free Via Novel Adaptive Critic Designs.

Integral reinforcement learning‐based optimal tracking control for uncertain nonlinear systems under input constraint and specified performance constraints

Optimal Adaptive Control of Linear Stochastic Systems with Quadratic Cost Function

The Adaptive Optimal Output Feedback Tracking Control of Unknown Discrete-Time Linear Systems Using a Multistep Q-Learning Approach

An Optimal Tracking Control Method with Q-learning for Discrete-time Linear Switched System

An Observer-Based Approximate Optimal Tracking Control for Nonlinear Systems with Persistent Disturbances

Adaptive Dynamic Programming for Tracking Design of Uncertain Nonlinear Systems with Disturbances and Input Constraints

Based on Q-Learning Optimal Tracking Control Schemes for Linear Itô Stochastic Systems with Markovian Jumps

A New Robust Output Tracking Control for Discrete-Time Switched Constrained-Input Systems with Uncertainty Via a Critic-Only Iteration Learning Method