Abstract:This study presents an adaptive optimal tracking control method for nonlinear strict‐feedback systems with unmeasurable states and asymmetric time‐varying constraints. The proposed control scheme converts constrained systems into their unconstrained counterparts by employing an observer‐critic‐actor reinforcement learning algorithm, thereby improving stability and tracking precision without using conventional barrier Lyapunov functions. Numerical and practical simulations validate the proposed control strategy's efficacy. In this article, the problem of adaptive optimal tracking control is studied for nonlinear strict‐feedback systems. While not directly measurable, the states of these systems are subject to both time‐varying and asymmetric constraints. Bypassing the conventional barrier Lyapunov function method, the constrained system is transformed into its unconstrained counterpart, thereby obviating the need for feasibility conditions. A specially designed reinforcement learning (RL) algorithm, featuring an observer‐critic‐actor architecture, is deployed in an adaptive optimal control scheme to ensure the stabilization of the converted unconstrained system. Within this architecture, the observer estimates the unmeasurable system states, the critic evaluates the control performance, and the actor executes the control actions. Furthermore, enhancements to the RL algorithm lead to relaxed conditions of persistent excitation, and the design methodology for the observer overcomes the restrictions imposed by the Hurwitz equation. The Lyapunov stability theorem is applied for two primary purposes: to ascertain the boundedness of all signals within the closed‐loop system, and to ensure the accuracy of the output signal in tracking the desired reference trajectory. Finally, numerical and practical simulations are provided to corroborate the effectiveness of the proposed control strategy.

Reinforcement learning‐based adaptive predefined‐time optimal tracking control for strict‐feedback nonlinear systems

A Learning-Based Optimal Tracking Controller for Continuous Linear Systems with Unknown Dynamics: Theory and Case Study

Fixed-Time Tracking Control for State-Constrained Nonstrict-Feedback Systems Without Feasibility Conditions

Reinforcement Learning-Based Predefined-Time Tracking Control for Nonlinear Systems Under Identifier-Critic-Actor Structure

Adaptive optimized backstepping tracking control for full‐state constrained nonlinear strict‐feedback systems without using barrier Lyapunov function method

Global Predefined-Time Adaptive Neural Network Control for Disturbed Pure-Feedback Nonlinear Systems With Zero Tracking Error

Adaptive Predefined-Time Fuzzy Tracking Control for Output Constrained Non-strict Feedback Nonlinear Systems with Input Saturation

Adaptive Predefined‐time Tracking Control for High‐order Strict‐feedback Nonlinear Systems with Unknown Mismatched Disturbances

Adaptive Fuzzy Control of Nonlinear Systems with Predefined Time and Accuracy

Event-triggered optimal tracking control for strict-feedback nonlinear systems with non-affine nonlinear faults

Asymptotic Tracking Controller Design for Nonlinear Systems with Guaranteed Performance.

Robust Adaptive Inverse Optimal Tracking for Strict-Feedback Nonlinear Systems

Integral reinforcement learning‐based optimal tracking control for uncertain nonlinear systems under input constraint and specified performance constraints

Near Optimal Neural Network-based Output Feedback Control of Affine Nonlinear Discrete-Time Systems

Adaptive Fuzzy Tracking Control With Global Prescribed-Time Prescribed Performance for Uncertain Strict-Feedback Nonlinear Systems

Globally Stable Adaptive Backstepping Neural Network Control for Uncertain Strict-Feedback Systems With Tracking Accuracy Known a Priori

Finite-time prescribed performance tracking control for nonlinear time-delay systems with state constraints and actuator hysteresis

Command Filter-Based Adaptive Neural Control for Nonstrict-Feedback Nonlinear Systems with Prescribed Performance

Neuroadaptive practical fixed-time tracking control for nonstrict-feedback nonlinear systems under event-triggered mechanism

A Novel Finite-Time Control for Nonstrict Feedback Saturated Nonlinear Systems With Tracking Error Constraint