Abstract:This study presents an adaptive optimal tracking control method for nonlinear strict‐feedback systems with unmeasurable states and asymmetric time‐varying constraints. The proposed control scheme converts constrained systems into their unconstrained counterparts by employing an observer‐critic‐actor reinforcement learning algorithm, thereby improving stability and tracking precision without using conventional barrier Lyapunov functions. Numerical and practical simulations validate the proposed control strategy's efficacy. In this article, the problem of adaptive optimal tracking control is studied for nonlinear strict‐feedback systems. While not directly measurable, the states of these systems are subject to both time‐varying and asymmetric constraints. Bypassing the conventional barrier Lyapunov function method, the constrained system is transformed into its unconstrained counterpart, thereby obviating the need for feasibility conditions. A specially designed reinforcement learning (RL) algorithm, featuring an observer‐critic‐actor architecture, is deployed in an adaptive optimal control scheme to ensure the stabilization of the converted unconstrained system. Within this architecture, the observer estimates the unmeasurable system states, the critic evaluates the control performance, and the actor executes the control actions. Furthermore, enhancements to the RL algorithm lead to relaxed conditions of persistent excitation, and the design methodology for the observer overcomes the restrictions imposed by the Hurwitz equation. The Lyapunov stability theorem is applied for two primary purposes: to ascertain the boundedness of all signals within the closed‐loop system, and to ensure the accuracy of the output signal in tracking the desired reference trajectory. Finally, numerical and practical simulations are provided to corroborate the effectiveness of the proposed control strategy.

Suboptimal Model Predictive Control for Nonlinear System on Tracking Problem

A Learning-Based Optimal Tracking Controller for Continuous Linear Systems with Unknown Dynamics: Theory and Case Study

Extended State Space Predictive Control for a Class of Nonlinear Systems

Adaptive Extended State Space Predictive Control for a Kind of Nonlinear Systems.

Nonlinear Model Predictive Control Based on Operating-Trajectory Model

Adaptive Predictive Functional Control for a Class of Nonlinear Systems

Self-tuning Scheme of Predictive Function Control's Reference Trajectory Based on Expected Response

Linear Mismatched Model Based Offset-Free Mpc For Nonlinear Constrained Systems With Both Stochastic And Deterministic Disturbances And Its Application To Cstr

Integral reinforcement learning‐based optimal tracking control for uncertain nonlinear systems under input constraint and specified performance constraints

H ∞ Reference Tracking Control Design for a Class of Nonlinear Systems with Time-Varying Delays

Direct Optimization Based Compensation Adaptive Robust Control of Nonlinear Systems with State and Input Constraints

Asymptotic Tracking Controller Design for Nonlinear Systems with Guaranteed Performance.

Optimization-based Adaptive Neural Sliding Mode Control for Nonlinear Systems with Fast and Accurate Response under State and Input Constraints

A Non-Linear Offset-Free Model Predictive Control Design Approach

Adaptive dynamic programming-based optimal control for nonlinear state constrained systems with input delay

Adaptive optimized backstepping tracking control for full‐state constrained nonlinear strict‐feedback systems without using barrier Lyapunov function method

Indirect Adaptive Optimal Tracking Switching Control of Nonlinear Systems

Robust Tracking Control of Unknown Nonlinear Systems With Discontinuous References Under Output Constraints

Constrained Reinforcement Learning-Based Closed-Loop Reference Model for Optimal Tracking Control of Unknown Continuous-Time Systems

Performance Guaranteed Tracking Control for Nonlinear Systems with Time-Varying Output Constraints and Full-State Constraints

Adaptive Fuzzy Tracking Control for Stochastic Nonlinear Systems with Full-State Constraints