Abstract:Background Deep learning technology has been widely applied to medical image analysis. But due to the limitations of its own imaging principle, ultrasound image has the disadvantages of low resolution and high Speckle Noise density, which not only hinder the diagnosis of patients’ conditions but also affect the extraction of ultrasound image features by computer technology. Objective In this study, we investigate the robustness of deep convolutional neural network (CNN) for classification, segmentation, and target detection of breast ultrasound image through random Salt & Pepper Noise and Gaussian Noise. Methods We trained and validated 9 CNN architectures in 8617 breast ultrasound images, but tested the models with noisy test set. Then, we trained and validated 9 CNN architectures with different levels of noise in these breast ultrasound images, and tested the models with noisy test set. Diseases of each breast ultrasound image in our dataset were annotated and voted by three sonographers based on their malignancy suspiciousness. we use evaluation indexes to evaluate the robustness of the neural network algorithm respectively. Results There is a moderate to high impact (The accuracy of the model decreased by about 5%-40%) on model accuracy when Salt and Pepper Noise, Speckle Noise, or Gaussian Noise is introduced to the images respectively. Consequently, DenseNet, UNet++ and Yolov5 were selected as the most robust model based on the selected index. When any two of these three kinds of noise are introduced into the image at the same time, the accuracy of the model will be greatly affected. Conclusions Our experimental results reveal new insights: The variation trend of accuracy with the noise level in Each network used for classification tasks and object detection tasks has some unique characteristics. This finding provides us with a method to reveal the black-box architecture of computer-aided diagnosis (CAD) systems. On the other hand, the purpose of this study is to explore the impact of adding noise directly to the image on the performance of neural networks, which is different from the existing articles on robustness in the field of medical image processing. Consequently, it provides a new way to evaluate the robustness of CAD systems in the future.

Computation of CNN’s Sensitivity to Input Perturbation

Fine-grained Recognition in the Noisy Wild: Sensitivity Analysis of Convolutional Neural Networks Approaches

Sensitivity of Spiking Neural Networks Due to Input Perturbation

An Estimator for the Sensitivity to Perturbations of Deep Neural Networks

Sensitivity Analysis of Deep Neural Networks

Propagated Perturbation of Adversarial Attack for well-known CNNs: Empirical Study and its Explanation

Investigating and unmasking feature-level vulnerabilities of CNNs to adversarial perturbations

Study on Analytical Noise Propagation in Convolutional Neural Network Methods Used in Computed Tomography Imaging

Variation-Tolerant Architectures for Convolutional Neural Networks in the Near Threshold Voltage Regime

Algorithm-Based Fault Tolerance for Convolutional Neural Networks

Certifying Robustness of Convolutional Neural Networks with Tight Linear Approximation

Network Robustness Prediction: Influence of Training Data Distributions

Sensitivity-based Acceleration and Compression Algorithm for Convolution Neural Network.

Analysis of Random Perturbations for Robust Convolutional Neural Networks

A study on the deviations in performance of FNNs and CNNs in the realm of grayscale adversarial images

Comparative Evaluation of Recent Universal Adversarial Perturbations in Image Classification

BET: Black-Box Efficient Testing for Convolutional Neural Networks

Visual Analytics of Neuron Vulnerability to Adversarial Attacks on Convolutional Neural Networks

Noise Perturbation for Saliency Prediction with Psychophysical Synthetic Images

Noise-robustness test for ultrasound breast nodule neural network models as medical devices

On the ability of CNNs to extract color invariant intensity based features for image classification