Abstract:Verifying safety of neural network control systems that use images as input is a difficult problem because, from a given system state, there is no known way to mathematically model what images are possible in the real-world. We build on recent work that considers a surrogate verification approach, training a conditional generative adversarial network (cGAN) as an image generator in place of the real world. This enables set-based formal analysis of the closed-loop system, providing analysis beyond simulation and testing. While existing work is effective on small examples, excessive overapproximation both within a single control period and across multiple control periods limits its scalability. We propose approaches to overcome these two sources of error. First, we overcome one-step error by composing the system's dynamics along with the cGAN and neural network controller, without losing the dependencies between input states and the control outputs as in the monotonic analysis of the system dynamics. Second, we reduce multi-step error by repeating the single-step composition, essentially unrolling multiple steps of the control loop into a large neural network. We then leverage existing network verification tools to compute accurate reachable sets for multiple steps, avoiding the accumulation of abstraction error at each step. We demonstrate the effectiveness of our approach in terms of both accuracy and scalability using two case studies: an autonomous aircraft taxiing system and an advanced emergency braking system. On the aircraft taxiing system, the converged reachable set is 175% larger using the prior baseline method compared with our proposed approach. On the emergency braking system, with 24x the number of image output variables from the cGAN, the baseline method fails to prove any states are safe, whereas our improvements enable set-based safety analysis.

Poster: Scalable and Interpretable Multilayer Overlay Network Checking via Ensemble Verification.

Integrated Multi-Scale Event Verification In An Augmented Foreground Motion Space

Toward Comprehensive Network Verification: Practices, Challenges and Beyond

Mahjong: A Generic Framework for Network Data Plane Verification

LIGHTYEAR: Using Modularity to Scale BGP Control Plane Verification

Deep Verifier Networks: Verification of Deep Discriminative Models with Deep Generative Models

Assisting Reachability Verification of Network Configurations Updates with NUV

A Survey on Network Verification and Testing With Formal Methods: Approaches and Challenges

Toward Scalable Verification for Safety-Critical Deep Networks

Scalable Surrogate Verification of Image-based Neural Network Control Systems using Composition and Unrolling

Proactively Verifying Quantitative Network Policy Across Unsafe and Unreliable Environments

Scalable Synthesis of Verified Controllers in Deep Reinforcement Learning

SLA-Verifier: Stateful and Quantitative Verification for Service Chaining

Carbide: Highly Reliable Networks Through Real-Time Multiple Control Plane Composition

Fine-grained Distributed Data Plane Verification with Intent-based Slicing

Modular Control Plane Verification via Temporal Invariants

NNV: The Neural Network Verification Tool for Deep Neural Networks and Learning-Enabled Cyber-Physical Systems

ProbNV: probabilistic verification of network control planes

Online Verification of Deep Neural Networks under Domain Shift or Network Updates

ECENet: Explainable and Context-Enhanced Network for Muti-modal Fact Verification

Expediting Neural Network Verification via Network Reduction