Abstract:This study presents an adaptive optimal tracking control method for nonlinear strict‐feedback systems with unmeasurable states and asymmetric time‐varying constraints. The proposed control scheme converts constrained systems into their unconstrained counterparts by employing an observer‐critic‐actor reinforcement learning algorithm, thereby improving stability and tracking precision without using conventional barrier Lyapunov functions. Numerical and practical simulations validate the proposed control strategy's efficacy. In this article, the problem of adaptive optimal tracking control is studied for nonlinear strict‐feedback systems. While not directly measurable, the states of these systems are subject to both time‐varying and asymmetric constraints. Bypassing the conventional barrier Lyapunov function method, the constrained system is transformed into its unconstrained counterpart, thereby obviating the need for feasibility conditions. A specially designed reinforcement learning (RL) algorithm, featuring an observer‐critic‐actor architecture, is deployed in an adaptive optimal control scheme to ensure the stabilization of the converted unconstrained system. Within this architecture, the observer estimates the unmeasurable system states, the critic evaluates the control performance, and the actor executes the control actions. Furthermore, enhancements to the RL algorithm lead to relaxed conditions of persistent excitation, and the design methodology for the observer overcomes the restrictions imposed by the Hurwitz equation. The Lyapunov stability theorem is applied for two primary purposes: to ascertain the boundedness of all signals within the closed‐loop system, and to ensure the accuracy of the output signal in tracking the desired reference trajectory. Finally, numerical and practical simulations are provided to corroborate the effectiveness of the proposed control strategy.

Adaptive Neural Network Optimal Backstepping Control of Strict Feedback Nonlinear Systems Via Reinforcement Learning

Adaptive Optimized Backstepping Control-Based RL Algorithm for Stochastic Nonlinear Systems with State Constraints and Its Application.

Neural network-based adaptive reinforcement learning for optimized backstepping tracking control of nonlinear systems with input delay

Adaptive Neural Network Control for a Class of Nonlinear Systems With Function Constraints on States

Neural Network Control-Based Adaptive Learning Design for Nonlinear Systems with Full-State Constraints.

Neural Networks Optimized Learning Control of State Constraints Systems

Observer-Based Neuro-Adaptive Optimized Control of Strict-Feedback Nonlinear Systems with State Constraints

Neural Networks-Based Adaptive Control for Nonlinear State Constrained Systems with Input Delay

Adaptive optimized backstepping tracking control for full‐state constrained nonlinear strict‐feedback systems without using barrier Lyapunov function method

Neuroadaptive Control of Strict Feedback Systems with Full-State Constraints and Unknown Actuation Characteristics: an Inexpensive Solution.

Reinforcement learning based adaptive optimal control for constrained nonlinear system via a novel state-dependent transformation

Adaptive Neural Network Control for Nonstrict-Feedback Uncertain Nonlinear Systems with Input Delay and Asymmetric Time-Varying State Constraints

Adaptive Neural Network Control of Uncertain Strict-Feedback Systems with Full-State Constrains by Integral-Barrier Lyapunov Functions

Adaptive Neural Network Control Design for Uncertain Nonstrict Feedback Nonlinear System with State Constraints

Output-Feedback Based Simplified Optimized Backstepping Control for Strict-Feedback Systems with Input and State Constraints

Inverse Optimal Adaptive Neural Control for State-Constrained Nonlinear Systems

NN Reinforcement Learning Adaptive Control for a Class of Nonstrict-Feedback Discrete-Time Systems

Adaptive backstepping neural control of state-delayed nonlinear systems with full-state constraints and unmodeled dynamics

Adaptive Neural Network Control for Nonlinear State Constrained Systems with Unknown Dead-Zones Input

Adaptive Neural Control of Nonlinear Nonstrict Feedback Systems With Full-State Constraints: A Novel Nonlinear Mapping Method

Adaptive Neural Network Learning Controller Design for a Class of Nonlinear Systems With Time-Varying State Constraints