Abstract:Learning-based control with safety guarantees usually requires real-time safety certification and modifications of possibly unsafe learning-based policies. The control barrier function (CBF) method uses a safety filter containing a constrained optimization problem to produce safe policies. However, finding a valid CBF for a general nonlinear system requires a complex function parameterization, which in general, makes the policy optimization problem difficult to solve in real time. For nonlinear systems with nonlinear state constraints, this paper proposes the novel concept of state-action CBFs, which not only characterize the safety at each state but also evaluate the control inputs taken at each state. State-action CBFs, in contrast to CBFs, enable a flexible parameterization, resulting in a safety filter that involves a convex quadratic optimization problem. This, in turn, significantly alleviates the online computational burden. To synthesize state-action CBFs, we propose a learning-based approach exploiting Hamilton-Jacobi reachability. The effect of learning errors on the effectiveness of state-action CBFs is addressed by constraint tightening and introducing a new concept called contractive CBFs. These contributions ensure formal safety guarantees for learned CBFs and control policies, enhancing the applicability of learning-based control in real-time scenarios. Simulation results on an inverted pendulum with elastic walls validate the proposed CBFs in terms of constraint satisfaction and CPU time.

Predictive Control Barrier Functions: Enhanced Safety Mechanisms for Learning-Based Control

Stability Mechanisms for Predictive Safety Filters

Approximate Predictive Control Barrier Functions using Neural Networks: A Computationally Cheap and Permissive Safety Filter

A Robust, Efficient Predictive Safety Filter

Safe Barrier-Constrained Control of Uncertain Systems via Event-triggered Learning

Learning a Better Control Barrier Function Under Uncertain Dynamics

Probabilistically safe controllers based on control barrier functions and scenario model predictive control

State-action control barrier functions: Imposing safety on learning-based control with low online computational costs

Learning for Layered Safety-Critical Control with Predictive Control Barrier Functions

Adaptive Safety-Critical Control for a Class of Nonlinear Systems with Parametric Uncertainties: A Control Barrier Function Approach

Safety-Critical Model Predictive Control with Discrete-Time Control Barrier Function

Learning for Safety-Critical Control with Control Barrier Functions

Learning-based Parameterized Barrier Function for Safety-Critical Control of Unknown Systems

On the Optimality, Stability, and Feasibility of Control Barrier Functions: An Adaptive Learning-Based Approach

Robustness of Control Barrier Functions for Safety Critical Control

Learning Control Barrier Functions with High Relative Degree for Safety-Critical Control

Safe and Stable Adaptive Control for a Class of Dynamic Systems

Adaptive Model Predictive Safety Certification for Learning-based Control -- Extended Version

A Learning-Based Method for Computing Control Barrier Functions of Nonlinear Systems With Control Constraints