Learning a Formally Verified Control Barrier Function in Stochastic Environment

Manan Tayal,Hongchao Zhang,Pushpak Jagtap,Andrew Clark,Shishir Kolathaya
2024-03-28
Abstract:Safety is a fundamental requirement of control systems. Control Barrier Functions (CBFs) are proposed to ensure the safety of the control system by constructing safety filters or synthesizing control inputs. However, the safety guarantee and performance of safe controllers rely on the construction of valid CBFs. Inspired by universal approximatability, CBFs are represented by neural networks, known as neural CBFs (NCBFs). This paper presents an algorithm for synthesizing formally verified continuous-time neural Control Barrier Functions in stochastic environments in a single step. The proposed training process ensures efficacy across the entire state space with only a finite number of data points by constructing a sample-based learning framework for Stochastic Neural CBFs (SNCBFs). Our methodology eliminates the need for post hoc verification by enforcing Lipschitz bounds on the neural network, its Jacobian, and Hessian terms. We demonstrate the effectiveness of our approach through case studies on the inverted pendulum system and obstacle avoidance in autonomous driving, showcasing larger safe regions compared to baseline methods.
Robotics
What problem does this paper attempt to address?
This paper attempts to address the challenge of ensuring the safety of control systems in stochastic environments. Specifically, the paper focuses on how to construct a formally verified continuous - time control barrier function (Stochastic Neural Control Barrier Function, SNCBF) through neural network learning to ensure the safety of control systems. Although traditional methods such as optimal control and Hamilton - Jacobi reachability analysis can handle some safety requirements, they have limitations in terms of rapid response capabilities and scalability in complex environments. In addition, most learning - based methods require a large number of unsafe interactions to learn a safe controller, which can be costly or infeasible in practical applications. To solve these problems, the paper proposes an algorithm that can synthesize a formally verified SNCBF in a single step. The algorithm ensures effectiveness in the entire state space by constructing a sample - learning framework and using a limited number of data points. To eliminate the need for posterior verification, the method proposed in the paper is achieved by imposing Lipschitz bounds on the neural network and its Jacobian and Hessian matrix terms. This method not only improves training efficiency but also ensures the formal verifiability of the learned SNCBF. The main contributions of the paper include: 1. **Proposing a training framework**: for synthesizing a neural control barrier function (NCBF) in a continuous - time stochastic environment with formal verifiability, eliminating the need for any posterior verification. 2. **Establishing a completeness guarantee**: by deriving effectiveness conditions, ensuring effectiveness in the entire state space using only a limited number of data points. This goal is achieved during the training process by imposing Lipschitz bounds on the neural network and its Jacobian and Hessian matrix terms. 3. **Verifying the effectiveness of the method through case studies**: Using two cases, the inverted pendulum system and obstacle avoidance in an autonomous driving system, the effectiveness of the proposed method in distinguishing between safe and unsafe areas is demonstrated, and it is proven that compared with the baseline method, the proposed method can ensure a larger safe area. In summary, this paper solves the key problem of ensuring the safety of control systems in stochastic environments by proposing a new algorithm, providing an effective solution for practical applications.