Abstract:The rapid development of deep learning has significantly transformed the ecology of the software engineering field. As new data continues to grow and evolve at an explosive rate, the challenge of iteratively updating software built on neural networks has become a critical issue. While the continuous learning paradigm enables networks to incorporate new data and update accordingly without losing previous memories, resulting in a batch of new networks as candidates for software updating, these approaches merely select from these networks by empirically testing their accuracy; they lack formal guarantees for such a batch of networks, especially in the presence of adversarial samples. Existing verification techniques, based on constraint solving, interval propagation, and linear approximation, provide formal guarantees but are designed to verify the properties of individual networks rather than a batch of networks. To address this issue, we analyze the batch verification problem corresponding to several non-traditional machine learning paradigms and further propose a framework named HOBAT (BATch verification for HOmogeneous structural neural networks) to enhance batch verification under reasonable assumptions about the representation of homogeneous structure neural networks, increasing scalability in practical applications. Our method involves abstracting the neurons at the same position in a batch of networks into a single neuron, followed by an iterative refinement process on the abstracted neuron to restore the precision until the desired properties for verification are met. Our method is orthogonal to boundary propagation verification on a single neural network. To assess our methodology, we integrate it with boundary propagation verification and observe significant improvements compared to the vanilla approach. Our experiments demonstrate the enormous potential for verifying large batches of networks in the era of big data.

Scalable Polyhedral Verification of Recurrent Neural Networks

Improving Neural Network Verification through Spurious Region Guided Refinement.

Towards Interpreting Recurrent Neural Networks Through Probabilistic Abstraction

PRIMA: general and precise neural network certification via scalable convex hull approximations

Verifying Recurrent Neural Networks using Invariant Inference

An abstract domain for certifying neural networks

Provable Preimage Under-Approximation for Neural Networks (Full Version)

A Dual Approach to Scalable Verification of Deep Networks

Learning-Based Verification of Stochastic Dynamical Systems with Neural Network Policies

Verification of deep probabilistic models

Bound Tightening using Rolling-Horizon Decomposition for Neural Network Verification

Provably Bounding Neural Network Preimages

HOBAT: Batch Verification for Homogeneous Structural Neural Networks

Toward Scalable Verification for Safety-Critical Deep Networks

Syntactic vs Semantic Linear Abstraction and Refinement of Neural Networks

Scalable Surrogate Verification of Image-based Neural Network Control Systems using Composition and Unrolling

Incremental Verification of Neural Networks

Efficient verification of neural networks based on neuron branching and LP abstraction

DiffRNN: Differential Verification of Recurrent Neural Networks

Verified Neural Compressed Sensing

Efficient Symbolic Reasoning for Neural-Network Verification