Abstract:This study presents an adaptive optimal tracking control method for nonlinear strict‐feedback systems with unmeasurable states and asymmetric time‐varying constraints. The proposed control scheme converts constrained systems into their unconstrained counterparts by employing an observer‐critic‐actor reinforcement learning algorithm, thereby improving stability and tracking precision without using conventional barrier Lyapunov functions. Numerical and practical simulations validate the proposed control strategy's efficacy. In this article, the problem of adaptive optimal tracking control is studied for nonlinear strict‐feedback systems. While not directly measurable, the states of these systems are subject to both time‐varying and asymmetric constraints. Bypassing the conventional barrier Lyapunov function method, the constrained system is transformed into its unconstrained counterpart, thereby obviating the need for feasibility conditions. A specially designed reinforcement learning (RL) algorithm, featuring an observer‐critic‐actor architecture, is deployed in an adaptive optimal control scheme to ensure the stabilization of the converted unconstrained system. Within this architecture, the observer estimates the unmeasurable system states, the critic evaluates the control performance, and the actor executes the control actions. Furthermore, enhancements to the RL algorithm lead to relaxed conditions of persistent excitation, and the design methodology for the observer overcomes the restrictions imposed by the Hurwitz equation. The Lyapunov stability theorem is applied for two primary purposes: to ascertain the boundedness of all signals within the closed‐loop system, and to ensure the accuracy of the output signal in tracking the desired reference trajectory. Finally, numerical and practical simulations are provided to corroborate the effectiveness of the proposed control strategy.

Robust Adaptive Inverse Optimal Tracking for Strict-Feedback Nonlinear Systems

Continuous Robust Tracking Controllers for a Class of Uncertain Nonlinear Dynamical Systems

A Learning-Based Optimal Tracking Controller for Continuous Linear Systems with Unknown Dynamics: Theory and Case Study

Direct adaptive fuzzy control of nonlinear strict-feedback systems

Adaptive Fuzzy Asymptotic Tracking for Nonlinear Systems With Nonstrict-Feedback Structure

Nonlinear System Inverse Chaos Anti-Control with Uncertainties

Adaptive Fuzzy Inverse Optimal Control for Uncertain Strict-Feedback Nonlinear Systems

Robust Tracking Control of Unknown Nonlinear Systems With Discontinuous References Under Output Constraints

Robust Adaptive Iterative Learning Control for Discrete‐time Nonlinear Systems with Both Parametric and Nonparametric Uncertainties

NN-based asymptotic tracking control for a class of strict-feedback uncertain nonlinear systems with output constraints

ℒ1adaptive Controller for a Class of Non-Affine Multi-Input Multi-Output Nonlinear Systems

Direct Adaptive Robust Fuzzy Control for Nonlinear Strict-Feedback Systems

Robust Adaptive Tracking Control for Nonlinearly Parameterized High-Order Systems With Unmatched Disturbances

ROBUST ADAPTIVE TRACKING CONTROL FOR A CLASS OF PERTURBED UNCERTAIN NONLINEAR SYSTEMS

Output-Feedback Robust Adaptive Control For Strict-Feed Back Stochastic Nonlinear Systems Under Inverse Optimality Costs

Reinforcement learning‐based adaptive predefined‐time optimal tracking control for strict‐feedback nonlinear systems

Adaptive Inverse Optimal Control for Strict-Feedback Stochastic Nonlinear Systems

Robust Adaptive Output Feedback Control of Nonlinearly Parameterized Systems

Adaptive optimized backstepping tracking control for full‐state constrained nonlinear strict‐feedback systems without using barrier Lyapunov function method

Adaptive fuzzy output tracking control for nonlinear systems in semi-strict feedback form

Robust Adaptive Tracking of Stochastic Nonlinear Systems with Uncertain Noises