Abstract:Quality assurance of deep neural networks (DNNs) is crucial for the deployment of DNN-based software, especially in mission- and safety-critical tasks. Inspired by structural white-box testing in traditional software, many test criteria have been proposed to test DNNs, i.e., to exhibit erroneous behaviors by activating new test units that have not been covered, such as new neurons, values, and decision paths. Many studies have been done to evaluate the effectiveness of DNN test coverage criteria. However, existing empirical studies mainly focused on measuring the effectiveness of DNN test criteria for improving the adversarial robustness of DNNs, while ignoring the correctness property when testing DNNs. To fill in this gap, we conduct a comprehensive study on 11 structural coverage criteria, 6 widely-used image datasets, and 9 popular DNNs. We investigate the effectiveness of DNN coverage criteria over natural inputs from 4 aspects: (1) the correlation between test coverage and test diversity; (2) the effects of criteria parameters and target DNNs; (3) the effectiveness to prioritize in-distribution natural inputs that lead to erroneous behaviors; (4) the capability to detect out-of-distribution natural samples. Our findings include: (1) For measuring the diversity, coverage criteria considering the relationship between different neurons are more effective than coverage criteria that treat each neuron independently. For instance, the neuron-path criteria (i.e., SNPC and ANPC) show high correlation with test diversity, which is promising to measure test diversity for DNNs. (2) The hyper-parameters have a big influence on the effectiveness of criteria, especially those relevant to the granularity of test criteria. Meanwhile, the computational complexity is one of the important issues to be considered when designing deep learning test coverage criteria, especially for large-scale models. (3) Test criteria related to data distribution (i.e., LSA and DSA, SNAC, and NBC) can be used to prioritize both in-distribution natural faults and out-of-distribution inputs. Furthermore, for OOD detection, the boundary metrics (i.e., SNAC and NBC) are also effective indicators with lower computational costs and higher detection efficiency compared with LSA and DSA. These findings motivate follow-up research on scalable test coverage criteria that improve the correctness of DNNs.

Are Coverage Criteria Meaningful Metrics for DNNs?

There is Limited Correlation Between Coverage and Robustness for Deep Neural Networks

An Empirical Study on Correlation between Coverage and Robustness for Deep Neural Networks

Can Coverage Criteria Guide Failure Discovery for Image Classifiers? an Empirical Study

Structural coverage criteria for neural networks could be misleading

NPC: Neuron Path Coverage via Characterizing Decision Logic of Deep Neural Networks

An Empirical Study on Correlations Between Deep Neural Network Fairness and Neuron Coverage Criteria

HashC: Making DNNs' Coverage Testing Finer and Faster.

Revisiting Deep Neural Network Test Coverage from the Test Effectiveness Perspective

Correlations Between Deep Neural Network Model Coverage Criteria and Model Quality

Increasing the Confidence of Deep Neural Networks by Coverage Analysis

Quantifying safety risks of deep neural networks

HashC: Making deep learning coverage testing finer and faster

Robust Black-box Testing of Deep Neural Networks using Co-Domain Coverage

Coverage Testing of Deep Learning Models using Dataset Characterization

Evaluating Deep Neural Networks in Deployment (A Comparative and Replicability Study)

Dependable Neural Networks for Safety Critical Tasks

Coverage-enhanced fault diagnosis for Deep Learning programs: A learning-based approach with hybrid metrics

A White-Box Testing for Deep Neural Networks Based on Neuron Coverage.

Verifying Safety of Neural Networks from Topological Perspectives

DeepPath: Path-driven Testing Criteria for Deep Neural Networks