Abstract:With its growing use in safety/security-critical applications, Deep Learning (DL) has raised increasing concerns regarding its dependability. In particular, DL has a notorious problem of lacking robustness. Input added with adversarial perturbations, i.e. Adversarial Examples (AEs) are easily mis-predicted by the DL model. Despite recent efforts made in detecting AEs via state-of-the-art attack and testing methods, they are normally input distribution agnostic and/or disregard the perceptual quality of adversarial perturbations. Consequently, the detected AEs are irrelevant inputs in the application context or unrealistic that can be easily noticed by humans. This may lead to a limited effect on improving the DL model’s dependability, as the testing budget is likely to be wasted on detecting AEs that are encountered very rarely in its real-life operations. In this paper, we propose a new robustness testing approach for detecting AEs that considers both the feature level distribution and the pixel level distribution, capturing the perceptual quality of adversarial perturbations. The two considerations are encoded by a novel hierarchical mechanism. First, we select test seeds based on the density of feature level distribution and the vulnerability of adversarial robustness. The vulnerability of test seeds are indicated by the auxiliary information, that are highly correlated with local robustness. Given a test seed, we then develop a novel genetic algorithm based local test case generation method, in which two fitness functions work alternatively to control the perceptual quality of detected AEs. Finally, extensive experiments confirm that our holistic approach considering hierarchical distributions is superior to the state-of-the-arts that either disregard any input distribution or only consider a single (non-hierarchical) distribution, in terms of not only detecting imperceptible AEs but also improving the overall robustness of the DL model under testing.

An empirical study on data distribution-aware test selection for deep learning enhancement

Evaluating the Robustness of Test Selection Methods for Deep Neural Networks

Adaptive Test Selection for Deep Neural Networks

Test Selection for Deep Learning Systems

Hierarchical Distribution-Aware Testing of Deep Learning

Distance-Aware Test Input Selection for Deep Neural Networks

DATTA: Towards Diversity Adaptive Test-Time Adaptation in Dynamic Wild World

DeepGD: A Multi-Objective Black-Box Test Selection Approach for Deep Neural Networks

In Defense of Simple Techniques for Neural Network Test Case Selection

Domain-wise Data Acquisition to Improve Performance under Distribution Shift

Practical Accuracy Evaluation for Deep Learning Systems Via Latent Representation Discrepancy.

Can test input selection methods for deep neural network guarantee test diversity? A large-scale empirical study

Neuron Sensitivity Guided Test Case Selection for Deep Learning Testing

A Comprehensive Survey on Test-Time Adaptation under Distribution Shifts

DeepState: Selecting Test Suites to Enhance the Robustness of Recurrent Neural Networks

Measuring Discrimination to Boost Comparative Testing for Multiple Deep Learning Models

DAT: Training Deep Networks Robust to Label-Noise by Matching the Feature Distributions

An Empirical Study on Distribution Shift Robustness from the Perspective of Pre-Training and Data Augmentation

Test Optimization in DNN Testing: A Survey

Multiple-Boundary Clustering and Prioritization to Promote Neural Network Retraining