Abstract:This study presents an adaptive optimal tracking control method for nonlinear strict‐feedback systems with unmeasurable states and asymmetric time‐varying constraints. The proposed control scheme converts constrained systems into their unconstrained counterparts by employing an observer‐critic‐actor reinforcement learning algorithm, thereby improving stability and tracking precision without using conventional barrier Lyapunov functions. Numerical and practical simulations validate the proposed control strategy's efficacy. In this article, the problem of adaptive optimal tracking control is studied for nonlinear strict‐feedback systems. While not directly measurable, the states of these systems are subject to both time‐varying and asymmetric constraints. Bypassing the conventional barrier Lyapunov function method, the constrained system is transformed into its unconstrained counterpart, thereby obviating the need for feasibility conditions. A specially designed reinforcement learning (RL) algorithm, featuring an observer‐critic‐actor architecture, is deployed in an adaptive optimal control scheme to ensure the stabilization of the converted unconstrained system. Within this architecture, the observer estimates the unmeasurable system states, the critic evaluates the control performance, and the actor executes the control actions. Furthermore, enhancements to the RL algorithm lead to relaxed conditions of persistent excitation, and the design methodology for the observer overcomes the restrictions imposed by the Hurwitz equation. The Lyapunov stability theorem is applied for two primary purposes: to ascertain the boundedness of all signals within the closed‐loop system, and to ensure the accuracy of the output signal in tracking the desired reference trajectory. Finally, numerical and practical simulations are provided to corroborate the effectiveness of the proposed control strategy.

Fast finite‐time adaptive tracking control for non‐strict feedback stochastic nonlinear systems with full state constraints

Fixed-Time Tracking Control for State-Constrained Nonstrict-Feedback Systems Without Feasibility Conditions

Adaptive finite-time tracking control for full state constrained nonlinear systems with time-varying delays and input saturation

Adaptive Fuzzy Tracking Control for Stochastic Nonlinear Systems with Full-State Constraints

Fast finite‐time stabilization of stochastic nonlinear systems with output constraints and an application to single‐link robot

Adaptive Neural Asymptotic Tracking Control for a Class of Stochastic Non-Strict-feedback Switched Systems

Adaptive Finite‐time Prescribed Performance Tracking Control for Unknown Nonlinear Systems Subject to Full‐state Constraints and Input Saturation

Adaptive Tracking Control for Stochastic Nonlinear Systems with Full-State Constraints and Unknown Covariance Noise

Finite-Time Adaptive Fuzzy Tracking Control for Nonlinear State Constrained Pure-Feedback Systems

Event-triggered Adaptive Tracking Control for Stochastic Nonlinear Systems With State Constraints

Adaptive finite-time tracking control of full state constrained nonlinear systems with dead-zone

Finite-Time Tracking Control for a Class of Uncertain Strict-Feedback Nonlinear Systems With State Constraints: A Smooth Control Approach

Finite-Time Adaptive Neural Control for a Class of Nonlinear Systems With Asymmetric Time-Varying Full-State Constraints

Adaptive optimized backstepping tracking control for full‐state constrained nonlinear strict‐feedback systems without using barrier Lyapunov function method

Command filter-based adaptive neural finite-time control for stochastic nonlinear systems with time-varying full-state constraints and asymmetric input saturation

Adaptive RBF Neural Network Tracking Control of Stochastic Nonlinear Systems with Actuators and State Constraints

Full State Constraints-Based Adaptive Tracking Control for Uncertain Nonlinear Stochastic Systems with Input Saturation

Barrier-Lyapunov-Based Adaptive Fuzzy Finite-Time Tracking of Pure-Feedback Nonlinear Systems with Constraints

Finite‐time command filter‐based adaptive tracking control for nonstrict feedback nonlinear systems with full‐state restrictions and unmodeled dynamics

Finite-Time Tracking Control for Nonlinear Systems via Adaptive Neural Output Feedback and Command Filtered Backstepping

Adaptive tracking control for constrained nonlinear nonstrict-feedback switched stochastic systems with unknown control directions