Abstract:This study presents an adaptive optimal tracking control method for nonlinear strict‐feedback systems with unmeasurable states and asymmetric time‐varying constraints. The proposed control scheme converts constrained systems into their unconstrained counterparts by employing an observer‐critic‐actor reinforcement learning algorithm, thereby improving stability and tracking precision without using conventional barrier Lyapunov functions. Numerical and practical simulations validate the proposed control strategy's efficacy. In this article, the problem of adaptive optimal tracking control is studied for nonlinear strict‐feedback systems. While not directly measurable, the states of these systems are subject to both time‐varying and asymmetric constraints. Bypassing the conventional barrier Lyapunov function method, the constrained system is transformed into its unconstrained counterpart, thereby obviating the need for feasibility conditions. A specially designed reinforcement learning (RL) algorithm, featuring an observer‐critic‐actor architecture, is deployed in an adaptive optimal control scheme to ensure the stabilization of the converted unconstrained system. Within this architecture, the observer estimates the unmeasurable system states, the critic evaluates the control performance, and the actor executes the control actions. Furthermore, enhancements to the RL algorithm lead to relaxed conditions of persistent excitation, and the design methodology for the observer overcomes the restrictions imposed by the Hurwitz equation. The Lyapunov stability theorem is applied for two primary purposes: to ascertain the boundedness of all signals within the closed‐loop system, and to ensure the accuracy of the output signal in tracking the desired reference trajectory. Finally, numerical and practical simulations are provided to corroborate the effectiveness of the proposed control strategy.

Adaptive Tracking Control of a Class of Linear Systems with Constrained Actuators

Continuous Robust Tracking Controllers for a Class of Uncertain Nonlinear Dynamical Systems

A Learning-Based Optimal Tracking Controller for Continuous Linear Systems with Unknown Dynamics: Theory and Case Study

Position Tracking Control of Fully-Actuated Underwater Vehicles with Constrained Attitude and Velocities

Fixed-Time Tracking Control for State-Constrained Nonstrict-Feedback Systems Without Feasibility Conditions

Asymptotic Tracking Controller Design for Nonlinear Systems with Guaranteed Performance.

Adaptive Fuzzy Tracking Control for a Class of Strict-Feedback Nonlinear Systems with Time-Varying Input Delay and Full State Constraints

Adaptive Fuzzy Asymptotic Tracking Control of State-Constrained High-Order Nonlinear Time-Delay Systems and Its Applications

Adaptive tracking control for switched strict-feedback nonlinear systems with time-varying delays and asymmetric saturation actuators.

Adaptive optimized backstepping tracking control for full‐state constrained nonlinear strict‐feedback systems without using barrier Lyapunov function method

Adaptive Full-State-Constrained Control of Nonlinear Systems With Deferred Constraints Based on Nonbarrier Lyapunov Function Method

Nonlinear Adaptive Tracking Control Based on Robust Control Lyapunov Function

Adaptive Fuzzy Asymptotic Tracking for Nonlinear Systems With Nonstrict-Feedback Structure

Adaptive Neural Control of a Class of Output-Constrained Nonaffine Systems.

Fixed-Time Fuzzy Adaptive Tracking Control of Full-State Constrained Nonlinear Systems with Unknown Virtual Control Coefficients

Adaptive Asymptotic Tracking Control for Underactuated Autonomous Underwater Vehicles with State Constraints

Adaptive Tracking Control for Tethered Aircraft Systems With Actuator Nonlinearities and Output Constraints

Adaptive Finite-Time Command Filtered Controller Design for Nonlinear Systems With Output Constraints and Input Nonlinearities

Neural networks-based adaptive tracking control for full-state constrained switched nonlinear systems with periodic disturbances and actuator saturation

Adaptive Non-Fragile Finite-Time Tracking Control of a Class of Uncertain Systems

Adaptive tracking control for constrained nonlinear nonstrict-feedback switched stochastic systems with unknown control directions