Abstract:We study the problem of formally verifying the robustness to adversarial examples of support vector machines (SVMs), a major machine learning model for classification and regression tasks. Following a recent stream of works on formal robustness verification of (deep) neural networks, our approach relies on a sound abstract version of a given SVM classifier to be used for checking its robustness. This methodology is parametric on a given numerical abstraction of real values and, analogously to the case of neural networks, needs neither abstract least upper bounds nor widening operators on this abstraction. The standard interval domain provides a simple instantiation of our abstraction technique, which is enhanced with the domain of reduced affine forms, which is an efficient abstraction of the zonotope abstract domain. This robustness verification technique has been fully implemented and experimentally evaluated on SVMs based on linear and nonlinear (polynomial and radial basis function) kernels, which have been trained on the popular MNIST dataset of images and on the recent and more challenging Fashion-MNIST dataset. The experimental results of our prototype SVM robustness verifier appear to be encouraging: this automated verification is fast, scalable and shows significantly high percentages of provable robustness on the test set of MNIST, in particular compared to the analogous provable robustness of neural networks.

Qualitative Robustness of Support Vector Machines

A Novel Robust Smooth Support Vector Machine

Quantitative Robustness of Localized Support Vector Machines

Robustness Verification of Support Vector Machines

Robust support vector machines via conic optimization

Learning properties of Support Vector Machines

Robust Support Vector Regression with Generalized Loss Function and Applications

Bounded quantile loss for robust support vector machines-based classification and regression

A Robust Optimization Model for Nonlinear Support Vector Machine

Robust Relative Margin Support Vector Machines

Qualitative robustness for bootstrap approximations

Domains of weak continuity of statistical functionals with a view toward robust statistics

A Learning Method for Robust Support Vector Machines

Training robust support vector regression via D. C. program

Robust twin support vector regression based on Huber loss function

Evaluating robustness of support vector machines with the Lagrangian dual approach

Robustness Enhancement for Proximal Support Vector Machines

Theoretical aspects of robust SVM optimization in Banach spaces and Nash equilibrium interpretation

A Robust Support Vector Machines Algorithm

Asymmetric and robust loss function driven least squares support vector machine