Abstract:Neural networks are successful in various applications but are also susceptible to adversarial attacks. To show the safety of network classifiers, many verifiers have been introduced to reason about the local robustness of a given input to a given perturbation. While successful, local robustness cannot generalize to unseen inputs. Several works analyze global robustness properties, however, neither can provide a precise guarantee about the cases where a network classifier does not change its classification. In this work, we propose a new global robustness property for classifiers aiming at finding the minimal globally robust bound, which naturally extends the popular local robustness property for classifiers. We introduce VHAGaR, an anytime verifier for computing this bound. VHAGaR relies on three main ideas: encoding the problem as a mixed-integer programming and pruning the search space by identifying dependencies stemming from the perturbation or the network's computation and generalizing adversarial attacks to unknown inputs. We evaluate VHAGaR on several datasets and classifiers and show that, given a three hour timeout, the average gap between the lower and upper bound on the minimal globally robust bound computed by VHAGaR is 1.9, while the gap of an existing global robustness verifier is 154.7. Moreover, VHAGaR is 130.6x faster than this verifier. Our results further indicate that leveraging dependencies and adversarial attacks makes VHAGaR 78.6x faster.

Evaluating robustness of support vector machines with the Lagrangian dual approach

Evaluating robustness of support vector machines with the Lagrangian dual approach

Robustness Verification of Support Vector Machines

Robustness Verification of Classification Deep Neural Networks Via Linear Programming.

A Robust Optimization Model for Nonlinear Support Vector Machine

Automated Design of Linear Bounding Functions for Sigmoidal Nonlinearities in Neural Networks

Robust optimization for adversarial learning with finite sample complexity guarantees

Enforcing Linearity in DNN Succours Robustness and Adversarial Image Generation

Verification of Geometric Robustness of Neural Networks via Piecewise Linear Approximation and Lipschitz Optimisation

A nonlinear kernel SVM classifier via L 0 / 1 soft-margin loss with classification performance

A Dual Approach to Scalable Verification of Deep Networks

A practical approach to evaluating the adversarial distance for machine learning classifiers

Robust Learning with Imperfect Privileged Information.

Certifying Robustness of Convolutional Neural Networks with Tight Linear Approximation

Robustra: Training Provable Robust Neural Networks over Reference Adversarial Space.

Towards General Robustness Verification of MaxPool-based Convolutional Neural Networks via Tightening Linear Approximation

Robust Support Vector Machine Using Least Median Loss Penalty

Robust support vector machine training via convex outlier ablation

Verification of Neural Networks' Global Robustness

Convex large margin training techniques: unsupervised, semi-supervised, and robust support vector machines

Robustness Verifcation in Neural Networks