Abstract:Learning-based control with safety guarantees usually requires real-time safety certification and modifications of possibly unsafe learning-based policies. The control barrier function (CBF) method uses a safety filter containing a constrained optimization problem to produce safe policies. However, finding a valid CBF for a general nonlinear system requires a complex function parameterization, which in general, makes the policy optimization problem difficult to solve in real time. For nonlinear systems with nonlinear state constraints, this paper proposes the novel concept of state-action CBFs, which not only characterize the safety at each state but also evaluate the control inputs taken at each state. State-action CBFs, in contrast to CBFs, enable a flexible parameterization, resulting in a safety filter that involves a convex quadratic optimization problem. This, in turn, significantly alleviates the online computational burden. To synthesize state-action CBFs, we propose a learning-based approach exploiting Hamilton-Jacobi reachability. The effect of learning errors on the effectiveness of state-action CBFs is addressed by constraint tightening and introducing a new concept called contractive CBFs. These contributions ensure formal safety guarantees for learned CBFs and control policies, enhancing the applicability of learning-based control in real-time scenarios. Simulation results on an inverted pendulum with elastic walls validate the proposed CBFs in terms of constraint satisfaction and CPU time.

BarrierNet: Differentiable Control Barrier Functions for Learning of Safe Robot Control

Learning Observation-Based Certifiable Safe Policy for Decentralized Multi-Robot Navigation

Safe Neural Control for Non-Affine Control Systems with Differentiable Control Barrier Functions

ABNet: Attention BarrierNet for Safe and Scalable Robot Learning

Learning Differentiable Safety-Critical Control using Control Barrier Functions for Generalization to Novel Environments

On the Optimality, Stability, and Feasibility of Control Barrier Functions: An Adaptive Learning-Based Approach

Adaptive Deep Neural Network-Based Control Barrier Functions

Learning for Safety-Critical Control with Control Barrier Functions

Neural Control Barrier Functions for Safe Navigation

Learning Control Barrier Functions with High Relative Degree for Safety-Critical Control

Fault Tolerant Neural Control Barrier Functions for Robotic Systems under Sensor Faults and Attacks

Learning-Based Control Barrier Function with Provably Safe Guarantees: Reducing Conservatism with Heading-Aware Safety Margin

Learning Local Control Barrier Functions for Hybrid Systems

End-to-End Safe Reinforcement Learning through Barrier Functions for Safety-Critical Continuous Control Tasks

Quantifying Safety of Learning-based Self-Driving Control Using Almost-Barrier Functions

Learning a Formally Verified Control Barrier Function in Stochastic Environment

Learning Barrier Functions With Memory for Robust Safe Navigation

Verification of Neural Control Barrier Functions with Symbolic Derivative Bounds Propagation

DADEE: Well-calibrated uncertainty quantification in neural networks for barriers-based robot safety

State-action control barrier functions: Imposing safety on learning-based control with low online computational costs