Abstract:With its growing use in safety/security-critical applications, Deep Learning (DL) has raised increasing concerns regarding its dependability. In particular, DL has a notorious problem of lacking robustness. Input added with adversarial perturbations, i.e. Adversarial Examples (AEs) are easily mis-predicted by the DL model. Despite recent efforts made in detecting AEs via state-of-the-art attack and testing methods, they are normally input distribution agnostic and/or disregard the perceptual quality of adversarial perturbations. Consequently, the detected AEs are irrelevant inputs in the application context or unrealistic that can be easily noticed by humans. This may lead to a limited effect on improving the DL model’s dependability, as the testing budget is likely to be wasted on detecting AEs that are encountered very rarely in its real-life operations. In this paper, we propose a new robustness testing approach for detecting AEs that considers both the feature level distribution and the pixel level distribution, capturing the perceptual quality of adversarial perturbations. The two considerations are encoded by a novel hierarchical mechanism. First, we select test seeds based on the density of feature level distribution and the vulnerability of adversarial robustness. The vulnerability of test seeds are indicated by the auxiliary information, that are highly correlated with local robustness. Given a test seed, we then develop a novel genetic algorithm based local test case generation method, in which two fitness functions work alternatively to control the perceptual quality of detected AEs. Finally, extensive experiments confirm that our holistic approach considering hierarchical distributions is superior to the state-of-the-arts that either disregard any input distribution or only consider a single (non-hierarchical) distribution, in terms of not only detecting imperceptible AEs but also improving the overall robustness of the DL model under testing.

A Robust Framework for Distributional Shift Detection Under Sample-Bias

Feature Shift Detection: Localizing Which Features Have Shifted via Conditional Distribution Tests

Beyond Discrepancy: A Closer Look at the Theory of Distribution Shift

A statistical framework for efficient out of distribution detection in deep neural networks

Rethinking Distribution Shifts: Empirical Analysis and Inductive Modeling for Tabular Data

DC4L: Distribution Shift Recovery via Data-Driven Control for Deep Learning Models

Fairness Hub Technical Briefs: Definition and Detection of Distribution Shift

Sequential Harmful Shift Detection Without Labels

A Robust Classifier Under Missing-Not-At-Random Sample Selection Bias

Automatic Fairness Testing of Neural Classifiers through Adversarial Sampling

Hierarchical Distribution-Aware Testing of Deep Learning

Even small correlation and diversity shifts pose dataset-bias issues

Is it Still Fair? A Comparative Evaluation of Fairness Algorithms through the Lens of Covariate Drift

Undersampling is a Minimax Optimal Robustness Intervention in Nonparametric Classification

Biquality learning: a framework to design algorithms dealing with closed-set distribution shifts

Benchmarking Low-Shot Robustness to Natural Distribution Shifts

MAGDiff: Covariate Data Set Shift Detection via Activation Graphs of Deep Neural Networks

Improving Distribution Alignment with Diversity-based Sampling

Distribution Mismatch Correction for Improved Robustness in Deep Neural Networks

Supervised Algorithmic Fairness in Distribution Shifts: A Survey

Learning Neural Models for Natural Language Processing in the Face of Distributional Shift