Abstract:This study presents an adaptive optimal tracking control method for nonlinear strict‐feedback systems with unmeasurable states and asymmetric time‐varying constraints. The proposed control scheme converts constrained systems into their unconstrained counterparts by employing an observer‐critic‐actor reinforcement learning algorithm, thereby improving stability and tracking precision without using conventional barrier Lyapunov functions. Numerical and practical simulations validate the proposed control strategy's efficacy. In this article, the problem of adaptive optimal tracking control is studied for nonlinear strict‐feedback systems. While not directly measurable, the states of these systems are subject to both time‐varying and asymmetric constraints. Bypassing the conventional barrier Lyapunov function method, the constrained system is transformed into its unconstrained counterpart, thereby obviating the need for feasibility conditions. A specially designed reinforcement learning (RL) algorithm, featuring an observer‐critic‐actor architecture, is deployed in an adaptive optimal control scheme to ensure the stabilization of the converted unconstrained system. Within this architecture, the observer estimates the unmeasurable system states, the critic evaluates the control performance, and the actor executes the control actions. Furthermore, enhancements to the RL algorithm lead to relaxed conditions of persistent excitation, and the design methodology for the observer overcomes the restrictions imposed by the Hurwitz equation. The Lyapunov stability theorem is applied for two primary purposes: to ascertain the boundedness of all signals within the closed‐loop system, and to ensure the accuracy of the output signal in tracking the desired reference trajectory. Finally, numerical and practical simulations are provided to corroborate the effectiveness of the proposed control strategy.

Optimal Tracking Control for Motion Constrained Robot Systems Via Event-Sampled Critic Learning

Tracking Control for Motion Constrained Robotic System Via Dynamic Event-Sampled Intelligent Learning Method.

A Learning-Based Optimal Tracking Controller for Continuous Linear Systems with Unknown Dynamics: Theory and Case Study

Event-triggered Learning-Based Robust Tracking Control for Robotic Manipulators with Uncertain Dynamics and Non-Zero Equilibrium

Fuzzy Adaptive Tracking of Constrained Nonlinear Systems with Event-Sampling Reinforcement Learning

Event-Triggered Optimal Tracking Control for Strict-Feedback Nonlinear Systems With Non-Affine Nonlinear Faults

Optimal tracking cooperative control for multi-agent systems with periodic sampling via robust model predictive control approach

Direct Optimization Based Compensation Adaptive Robust Control of Nonlinear Systems with State and Input Constraints

Neural network based tracking control for an elastic joint robot with input constraint via actor-critic design

Learning-Based Tracking Control of Unknown Robot Systems with Online Parameter Estimation

Event-triggered optimal control with finite-time convergence critic networks for input-constrained nonlinear systems

Critic-Only Learning Based Tracking Control for Uncertain Nonlinear Systems with Prescribed Performance

Event-Triggered Robust Optimal Control for Robotic Manipulators with Input Constraints Via Adaptive Dynamic Programming

Event-Triggered Learning Robust Tracking Control of Robotic Systems with Unknown Uncertainties

Adaptive optimized backstepping tracking control for full‐state constrained nonlinear strict‐feedback systems without using barrier Lyapunov function method

Reinforcement learning-based adaptive tracking control for flexible-joint robotic manipulators

Event-triggered Receding Horizon Control Via Actor-Critic Design

Adaptive Neural Event-Triggered Optimal Tracking Control for Discrete-Time Pure-Feedback Systems

Event-triggered-based adaptive command-filtered asymptotic tracking control for flexible robotic manipulators

Adaptive Critic Based Optimal Kinematic Control for a Robot Manipulator