Abstract:In this article, we propose a robust high-order control barrier functions (HoCBFs)-based optimal control method for nonlinear systems with state constraints to achieve safety-stability perspectives. First, a kind of HoCBFs is presented for constrained nonlinear systems to address state constraints with high relative degrees. Second, the robustness property of the HoCBFs is analyzed based on the asymptotic stability of the forward invariant set. Specifically, a robust HoCBFs-based Lyapunov function is constructed to prove the uniform asymptotic stability of the set associated with the HoCBFs. In this way, a new sufficient condition is obtained for the stability analysis of the forward invariant set by using the inequalities of high-order derivatives of Lyapunov function. Third, a robust HoCBFs-based optimal control scheme is proposed for the constrained nonlinear system to achieve the safety-stability perspectives of constraints satisfaction and system stabilization, where the robust HoCBFs are combined with control Lyapunov functions (CLFs) to satisfy the small control property (SCP) in solving a quadratic program (QP). Furthermore, the proposed optimal control scheme is shown to be Lipschitz continuous and has no initial condition restrictions. Finally, two examples are presented to demonstrate the control performance of the proposed scheme. Note to Practitioners-The motivation of this article is that constraints exist widely in actual control systems, and the lack of constraint satisfaction in control systems may inevitably lead to safety defects, which usually degrade the control performances or even damage the entire system. In this article, a robust HoCBFs-based optimal control scheme is proposed for constrained nonlinear systems. The theoretical derivation demonstrates that the proposed control scheme can achieve safety-stability perspectives, which ensure system stabilization and task-oriented performance without violating the state constraints. The satisfactory control performances of the simulation on a constrained robotic manipulator show the potential practical application on a real robotic system.

Optimal Control for Constrained Discrete-Time Nonlinear Systems Based on Safe Reinforcement Learning.

Reinforcement Learning-Based Control for Nonlinear Discrete-Time Systems with Unknown Control Directions and Control Constraints

Adaptive Optimized Backstepping Control-Based RL Algorithm for Stochastic Nonlinear Systems with State Constraints and Its Application.

NN Reinforcement Learning Adaptive Control for a Class of Nonstrict-Feedback Discrete-Time Systems

Discrete-Time Nonlinear Optimal Control Using Multi-Step Reinforcement Learning

Reinforcement Learning-Based Control for a Class of Nonlinear Systems with Unknown Control Directions

Off-Policy Risk-Sensitive Reinforcement Learning-Based Constrained Robust Optimal Control

Robust Safe Reinforcement Learning Control of Unknown Continuous-Time Nonlinear Systems with State Constraints and Disturbances

Reinforcement learning based adaptive optimal control for constrained nonlinear system via a novel state-dependent transformation

NN-Based Reinforcement Learning Optimal Control for Inequality-Constrained Nonlinear Discrete-Time Systems With Disturbances

Adaptive Neural Network Optimal Backstepping Control of Strict Feedback Nonlinear Systems Via Reinforcement Learning

Reinforcement Learning Controller Design for Discrete-Time-Constrained Nonlinear Systems With Weight Initialization Method

Physics‐informed reinforcement learning for optimal control of nonlinear systems

Adaptive Optimal Robust Control for Uncertain Nonlinear Systems Using Neural Network Approximation in Policy Iteration

Reinforcement Learning-Based Adaptive Finite-Time Performance Constraint Control for Nonlinear Systems

Suboptimal Reduced Control of Unknown Nonlinear Singularly Perturbed Systems Via Reinforcement Learning

Generalized Policy Iteration-based Reinforcement Learning Algorithm for Optimal Control of Unknown Discrete-time Systems

Robust High-Order Control Barrier Functions-Based Optimal Control for Constrained Nonlinear Systems with Safety-Stability Perspectives

Online Off-Policy Reinforcement Learning for Optimal Control of Unknown Nonlinear Systems Using Neural Networks

Constrained Optimal Control for Nonlinear Multi-Input Safety-Critical Systems with Time-Varying Safety Constraints

Balancing Value Iteration and Policy Iteration for Discrete-Time Control.