Abstract:Neural networks (NNs) are increasingly applied in safety-critical systems such as autonomous vehicles. However, they are fragile and are often ill-behaved. Consequently, their behaviors should undergo rigorous guarantees before deployment in practice. In this paper, we propose a set-boundary reachability method to investigate the safety verification problem of NNs from topological perspectives. Given an NN with an input set and a safe set, the safety verification problem is to determine whether all outputs of the NN resulting from the input set fall within the safe set. In our method, the homeomorphism property of NNs is first exploited, which establishes rigorous guarantees between the boundaries of the input set and the boundaries of the output set. A homeomorphism is a special case of open maps, and consequently our set-boundary method is considered to be generalized to situations with open map property then 2 2. The exploitation of these two properties facilitates reachability computations via extracting subsets of the input set rather than the entire input set, thus controlling the wrapping effect in reachability analysis and facilitating the reduction of computation burdens for safety verification. The homeomorphism property exists in some widely used NNs such as invertible residual networks (i-ResNets) and Neural ordinary differential equations (Neural ODEs), and the open map is a less strict topological property and is easier to satisfy compared with homeomorphisms. For NNs establishing either of these two properties, our set-boundary reachability method only needs to perform reachability analysis on the boundary of the input set. Moreover, for NNs that do not feature these properties with respect to the input set, we also explore subsets of the input set for establishing the local homeomorphism property and then abandon these subsets for reachability computations. Finally, some examples demonstrate the performance of our proposed method.

Safety Verification of Neural Feedback Systems Based on Constrained Zonotopes

Reachability Analysis and Safety Verification of Neural Feedback Systems via Hybrid Zonotopes

Backward Reachability Analysis of Neural Feedback Systems Using Hybrid Zonotopes

Hybrid Zonotope-Based Backward Reachability Analysis for Neural Feedback Systems With Nonlinear Plant Models

Verification of Neural Network Control Systems using Symbolic Zonotopes and Polynotopes

Model-Free Verification for Neural Network Controlled Systems

Verifying Safety of Neural Networks from Topological Perspectives

NN-based asymptotic tracking control for a class of strict-feedback uncertain nonlinear systems with output constraints

Reachability Analysis and Safety Verification for Neural Network Control Systems

Verification of Neural Reachable Tubes via Scenario Optimization and Conformal Prediction

Interval Reachability of Nonlinear Dynamical Systems with Neural Network Controllers

Safety verification of Neural-Network-based controllers: a set invariance approach

Verifying Neural Network Controlled Systems Using Neural Networks

System-level Safety Guard: Safe Tracking Control through Uncertain Neural Network Dynamics Models

Controllability Verification for Constrained Networked Dynamic Systems

Verification and Design of Robust and Safe Neural Network-enabled Autonomous Systems

Formally Verified Physics-Informed Neural Control Lyapunov Functions

Simultaneous Synthesis and Verification of Neural Control Barrier Functions through Branch-and-Bound Verification-in-the-loop Training

Backward Reachability Analysis for Neural Feedback Loops

Compositionally Verifiable Vector Neural Lyapunov Functions for Stability Analysis of Interconnected Nonlinear Systems

Safe Nonlinear Control Using Robust Neural Lyapunov-Barrier Functions