Abstract:This study presents an adaptive optimal tracking control method for nonlinear strict‐feedback systems with unmeasurable states and asymmetric time‐varying constraints. The proposed control scheme converts constrained systems into their unconstrained counterparts by employing an observer‐critic‐actor reinforcement learning algorithm, thereby improving stability and tracking precision without using conventional barrier Lyapunov functions. Numerical and practical simulations validate the proposed control strategy's efficacy. In this article, the problem of adaptive optimal tracking control is studied for nonlinear strict‐feedback systems. While not directly measurable, the states of these systems are subject to both time‐varying and asymmetric constraints. Bypassing the conventional barrier Lyapunov function method, the constrained system is transformed into its unconstrained counterpart, thereby obviating the need for feasibility conditions. A specially designed reinforcement learning (RL) algorithm, featuring an observer‐critic‐actor architecture, is deployed in an adaptive optimal control scheme to ensure the stabilization of the converted unconstrained system. Within this architecture, the observer estimates the unmeasurable system states, the critic evaluates the control performance, and the actor executes the control actions. Furthermore, enhancements to the RL algorithm lead to relaxed conditions of persistent excitation, and the design methodology for the observer overcomes the restrictions imposed by the Hurwitz equation. The Lyapunov stability theorem is applied for two primary purposes: to ascertain the boundedness of all signals within the closed‐loop system, and to ensure the accuracy of the output signal in tracking the desired reference trajectory. Finally, numerical and practical simulations are provided to corroborate the effectiveness of the proposed control strategy.

Adaptive optimized backstepping tracking control for full‐state constrained nonlinear strict‐feedback systems without using barrier Lyapunov function method

Fixed-Time Tracking Control for State-Constrained Nonstrict-Feedback Systems Without Feasibility Conditions

Asymptotic tracking control for uncertain strict-feedback nonlinear systems with delayed full-state constraints

Adaptive Tracking Control of State-Constrained Strict-Feedback Nonlinear Systems Using Direct Method

Adaptive Fuzzy Output-Feedback Tracking Control for Nonlinear Time-Varying State-Constrained Systems Without the Feasibility Condition

Adaptive Full-State-Constrained Control of Nonlinear Systems With Deferred Constraints Based on Nonbarrier Lyapunov Function Method

Adaptive Neural Network Optimal Backstepping Control of Strict Feedback Nonlinear Systems Via Reinforcement Learning

Adaptive tracking control for constrained nonlinear nonstrict-feedback switched stochastic systems with unknown control directions

Fuzzy Adaptive Tracking of Constrained Nonlinear Systems with Event-Sampling Reinforcement Learning

Finite‐time Tracking for State‐constrained Strict‐feedback Systems Without Feasibility Conditions

Adaptive Barrier-Lyapunov-Functions Based Control Scheme of Nonlinear Pure-Feedback Systems with Full State Constraints and Asymptotic Tracking Performance

Observer-Based Adaptive Fuzzy Control for Nonlinear State-Constrained Systems Without Involving Feasibility Conditions

Observer-Based Adaptive Fuzzy Tracking Control Using Integral Barrier Lyapunov Functionals for A Nonlinear System With Full State Constraints

Output Tracking Control of Strict-Feedback Non-Linear Systems under Asymmetrically Bilateral and Time-Varying Full-State Constraints

Reinforcement learning based adaptive optimal control for constrained nonlinear system via a novel state-dependent transformation

Adaptive Fuzzy Asymptotic Tracking for Nonlinear Systems With Nonstrict-Feedback Structure

Adaptive Optimized Backstepping Control-Based RL Algorithm for Stochastic Nonlinear Systems with State Constraints and Its Application.

Adaptive Finite‐time Prescribed Performance Tracking Control for Unknown Nonlinear Systems Subject to Full‐state Constraints and Input Saturation

Adaptive Fuzzy Tracking Control for Non‐strict‐feedback Non‐linear Systems with Non‐constant Delays and Full State Constraints

Adaptive Event‐triggered Tracking Control for a Class of Stochastic Nonlinear Systems with Full‐state Constraints

Observer-Based Neuro-Adaptive Optimized Control of Strict-Feedback Nonlinear Systems with State Constraints