Abstract:Nowadays, we are witnessing an increasing effort to improve the performance and trustworthiness of Deep Neural Networks (DNNs), with the aim to enable their adoption in safety critical systems such as self-driving cars or aircraft collision-avoidance systems. Multiple testing techniques are proposed to generate test cases that can expose inconsistencies in the behavior of DNN models. These techniques assume implicitly that the training program is bug-free and appropriately configured. However, satisfying this assumption for a novel problem requires significant engineering work to prepare the data, design the DNN, implement the training program, and tune the hyperparameters in order to produce the model for which current automated test data generators search for corner-case behaviors. All these model training steps can be error-prone. Therefore, it is crucial to detect and correct errors throughout all the engineering steps of DNN-based software systems and not only on the resulting DNN model. In this paper, we gather a catalog of training issues and based on their symptoms and their effects on the behavior of the training program, we propose practical verification routines to detect the aforementioned issues, automatically, by continuously validating that some important properties of the learning dynamics hold during the training. Then, we design, TheDeepChecker , an end-to-end property-based debugging approach for DNN training programs and implement it as a TensorFlow-based library. As an empirical evaluation, we conduct a case study to assess the effectiveness of TheDeepChecker on synthetic and real-world buggy DL programs and compare its performance to that of the Amazon SageMaker Debugger ( SMD ). Results show that TheDeepChecker ’s on-execution validation of DNN-based program’s properties through three sequential phases (pre-, on-, and post-fitting), succeeds in revealing several coding bugs and system misconfigurations errors, early on and at a low cost. Moreover, our property-based approach outperforms the SMD ’s offline rules verification on training logs in terms of detection accuracy for unstable learning issues and coverage of additional DL bugs.

Deep Validation: Toward Detecting Real-World Corner Cases for Deep Neural Networks

There is Limited Correlation Between Coverage and Robustness for Deep Neural Networks

An Empirical Study on Correlation between Coverage and Robustness for Deep Neural Networks

Testing Feedforward Neural Networks Training Programs

Self-Checking Deep Neural Networks in Deployment

Validity Matters: Uncertainty‐Guided Testing of Deep Neural Networks

DeepXplore: Automated Whitebox Testing of Deep Learning Systems

Excitement Surfeited Turns to Errors: Deep Learning Testing Framework Based on Excitable Neurons

Self-Checking Deep Neural Networks for Anomalies and Adversaries in Deployment

Automated Testing for Deep Learning Systems with Differential Behavior Criteria

Assessing Systematic Weaknesses of DNNs using Counterfactuals

DeepTest: Automated Testing of Deep-Neural-Network-driven Autonomous Cars

DeepGauge: Comprehensive and Multi-Granularity Testing Criteria for Gauging the Robustness of Deep Learning Systems.

DeepDyve: Dynamic Verification for Deep Neural Networks

Dct: Differential Combination Testing Of Deep Learning Systems

DeepRTest: A Vulnerability-Guided Robustness Testing and Enhancement Framework for Deep Neural Networks.

Validating a Deep Learning Framework by Metamorphic Testing

Data Sanity Check for Deep Learning Systems via Learnt Assertions

Fail-Safe Execution of Deep Learning based Systems through Uncertainty Monitoring

Reliability Assurance for Deep Neural Network Architectures Against Numerical Defects

Corner case data description and detection