Abstract:Regarding the interpretable techniques in the field of image recognition, Grad-CAM is widely used for feature localization in images to reflect the logical decision-making information behind the neural network due to its high applicability. However, extensive experimentation on a customized dataset revealed that the deep convolutional neural network (CNN) model based on Gradient-weighted Class Activation Mapping (Grad-CAM) technology cannot effectively resist the interference of large-scale noise. In this article, an optimization of the deep CNN model was proposed by incorporating the Dropkey and Dropout (as a comparison) algorithm. Compared with Grad-CAM, the improved Grad-CAM based on Dropkey applies an attention mechanism to the feature map before calculating the gradient, which can introduce randomness and eliminate some areas by applying a mask to the attention score. Experimental results show that the optimized Grad-CAM deep CNN model based on the Dropkey algorithm can effectively resist large-scale noise interference and achieve accurate localization of image features. For instance, under the interference of a noise variance of 0.6, the Dropkey-enhanced ResNet50 model achieves a confidence level of 0.878 in predicting results, while the other two models exhibit confidence levels of 0.766 and 0.481, respectively. Moreover, it exhibits excellent performance in visualizing tasks related to image features such as distortion, low contrast, and small object characteristics. Furthermore, it has promising prospects in practical computer vision applications. For instance, in the field of autonomous driving, it can assist in verifying whether deep learning models accurately understand and process crucial objects, road signs, pedestrians, or other elements in the environment.

Attentiondrop For Convolutional Neural Networks

TargetDrop: A Targeted Regularization Method for Convolutional Neural Networks

Correlation-based Structural Dropout for Convolutional Neural Networks

Effective and Efficient Dropout for Deep Convolutional Neural Networks

Regularizing neural networks with adaptive local drop

DCCD: Reducing Neural Network Redundancy Via Distillation

The Overfocusing Bias of Convolutional Neural Networks: A Saliency-Guided Regularization Approach

DropAttention: A Regularization Method for Fully-Connected Self-Attention Networks

Continuous Dropout

Nesterov Accelerated Gradient Descent-Based Convolution Neural Network with Dropout for Facial Expression Recognition.

Flip-Rotate-Pooling Convolution and Split Dropout on Convolution Neural Networks for Image Classification

R-Drop: Regularized Dropout for Neural Networks.

LocalDrop: A Hybrid Regularization for Deep Neural Networks

On Dropping Clusters to Regularize Graph Convolutional Neural Networks

AutoDropout: Learning Dropout Patterns to Regularize Deep Networks

Optimized Dropkey-Based Grad-CAM: Toward Accurate Image Feature Localization

Towards Dropout Training for Convolutional Neural Networks

Locality-Aware Channel-Wise Dropout for Occluded Face Recognition

Rethinking the Usage of Batch Normalization and Dropout in the Training of Deep Neural Networks

Don't ignore Dropout in Fully Convolutional Networks

Informative Dropout for Robust Representation Learning: A Shape-bias Perspective