Abstract:Deep neural networks have proven to be extremely powerful, however, they are also vulnerable to adversarial attacks which can cause hazardous incorrect predictions in safety-critical applications. Certified robustness via randomized smoothing gives a probabilistic guarantee that the smoothed classifier's predictions will not change within an $\ell_2$-ball around a given input. On the other hand (uncertainty) score-based rejection is a technique often applied in practice to defend models against adversarial attacks. In this work, we fuse these two approaches by integrating a classifier that abstains from predicting when uncertainty is high into the certified robustness framework. This allows us to derive two novel robustness guarantees for uncertainty aware classifiers, namely (i) the radius of an $\ell_2$-ball around the input in which the same label is predicted and uncertainty remains low and (ii) the $\ell_2$-radius of a ball in which the predictions will either not change or be uncertain. While the former provides robustness guarantees with respect to attacks aiming at increased uncertainty, the latter informs about the amount of input perturbation necessary to lead the uncertainty aware model into a wrong prediction. Notably, this is on CIFAR10 up to 20.93% larger than for models not allowing for uncertainty based rejection. We demonstrate, that the novel framework allows for a systematic robustness evaluation of different network architectures and uncertainty measures and to identify desired properties of uncertainty quantification techniques. Moreover, we show that leveraging uncertainty in a smoothed classifier helps out-of-distribution detection.

Robust Regression over Averaged Uncertainty

Robust Estimation and Shrinkage in Ultrahigh Dimensional Expectile Regression with Heavy Tails and Variance Heterogeneity

RS-Reg: Probabilistic and Robust Certified Regression Through Randomized Smoothing

Robust Regularized Kernel Regression.

New Robust Optimization Approach Induced by Flexible Uncertainty Set: Optimization under Continuous Uncertainty

Learning Decision-Focused Uncertainty Sets in Robust Optimization

Variable-Sized Uncertainty and Inverse Problems in Robust Optimization

First order dependence on uncertainty sets in robust optimization

Robust portfolio selection based on asymmetric measures of variability of stock returns

Integrating uncertainty quantification into randomized smoothing based robustness guarantees

Robust Uncertainty Sensitivity Analysis

A Statistical Perspective on Linear Programs with Uncertain Parameters

Robust Bayesian Model Averaging for Linear Regression Models With Heavy-Tailed Errors

Machine Learning-Based Data-Driven Robust Optimization Approach under Uncertainty

Robust portfolio optimization for recommender systems considering uncertainty of estimated statistics

Outlier Detection Using Robust Optimization with Uncertainty Sets Constructed from Risk Measures.

Universal Robust Regression via Maximum Mean Discrepancy

Model-Free Robust Average-Reward Reinforcement Learning

Effective Budget of Uncertainty for Classes of Robust Optimization

A Unified Framework for Adjustable Robust Optimization with Endogenous Uncertainty

Robust Min-Max (Regret) Optimization using Ordered Weighted Averaging