Abstract:While prior research has proposed a plethora of methods that build neural classifiers robust against adversarial robustness, practitioners are still reluctant to adopt them due to their unacceptably severe clean accuracy penalties. This paper significantly alleviates this accuracy-robustness trade-off by mixing the output probabilities of a standard classifier and a robust classifier, where the standard network is optimized for clean accuracy and is not robust in general. We show that the robust base classifier's confidence difference for correct and incorrect examples is the key to this improvement. In addition to providing intuitions and empirical evidence, we theoretically certify the robustness of the mixed classifier under realistic assumptions. Furthermore, we adapt an adversarial input detector into a mixing network that adaptively adjusts the mixture of the two base models, further reducing the accuracy penalty of achieving robustness. The proposed flexible method, termed "adaptive smoothing", can work in conjunction with existing or even future methods that improve clean accuracy, robustness, or adversary detection. Our empirical evaluation considers strong attack methods, including AutoAttack and adaptive attack. On the CIFAR-100 dataset, our method achieves an 85.21% clean accuracy while maintaining a 38.72% $\ell_\infty$-AutoAttacked ($\epsilon = 8/255$) accuracy, becoming the second most robust method on the RobustBench CIFAR-100 benchmark as of submission, while improving the clean accuracy by ten percentage points compared with all listed models. The code that implements our method is available at <a class="link-external link-https" href="https://github.com/Bai-YT/AdaptiveSmoothing" rel="external noopener nofollow">this https URL</a>.

Smoothing LUT classifiers for robust face detection

Towards Mask-robust Face Recognition.

Robust Face Recognition by Fusion Local Singular Value Feature and Deformable Model

L0 image smoothing via iterating truncated L1 gradient regularization

InterFace:Adjustable Angular Margin Inter-class Loss for Deep Face Recognition

Face recognition with contiguous occlusion using linear regression and level set method

Multiclass AdaBoost ELM and Its Application in LBP Based Face Recognition

Laplacian Smoothing Transform for Face Recognition

Robust Face Alignment Based on Local Texture Classifiers

Boosting 2-Thresholded Weak Classifiers over Scattered Rectangle Features for Object Detection.

Face Recognition Based on LDA and Improved Pairwise-Constrained Multiple Metric Learning Method.

Face Recognition Based on Local Binary Pattern and Improved Pairwise-constrained Multiple Metric Learning

Two-Stage Multi-Class Adaboost for Facial Expression Recognition

Accurate face detection by combining multiple classifiers using locally assembled histograms of oriented gradients

UniTSFace: Unified Threshold Integrated Sample-to-Sample Loss for Face Recognition

Regularized Training and Tight Certification for Randomized Smoothed Classifier with Provable Robustness

AttentionLut: Attention Fusion-based Canonical Polyadic LUT for Real-time Image Enhancement

Robust Face Alignment Based on Hierarchical Classifier Network

Improving the Accuracy-Robustness Trade-Off of Classifiers via Adaptive Smoothing

Lut-Based Adaboost For Gender Classification

SepLUT: Separable Image-adaptive Lookup Tables for Real-time Image Enhancement