Abstract:This study presents a deep learning research aimed at improving the performance of image classification models and increasing interpretability as well. We explore ways to improve the model by combining attention mechanisms with convolutional neural networks. This study uses garbage classification data in public datasets for training in a supervised learning manner, and employs Grad-CAM (Gradient-weighted Class Activation Mapping) with channel attention mechanism SE (Squeeze-and-Excitation) to generate heat maps for better understanding the decision-making process of the model's classification. By using the Grad-CAM function to generate heat maps, it is possible to visualize the areas which the model focuses on during classification. This provides a method to explain the model's classification decisions, allowing us to better understand the basis of the model's decisions on different categories of images. The model is improved by adding attention modules to different stages of the ResNet50 (Residual Network-50) network, thereby improving the accuracy and performance of the network. We notice that within the same stage, the structure and required attention of each module are consistent, so only one attention module is added in each stage to reduce the burden of network learning and speed up learning. In order to simplify the calculation process of attention, a global tensor is introduced to store the attention of each stage, thereby avoiding repeated calculations in each module. The experimental results show that compared with traditional convolutional neural networks, our proposed method achieves better performance on garbage classification tasks. By combining the attention mechanism and heat map interpretation, our model is able to improve classification accuracy. This is of great significance for image classification tasks in practical applications and helps to promote the research progress of deep learning in interpretability.

Attention Backpropagation

Exclusive Feature Constrained Class Activation Mapping for Better Visual Explanation.

Statistic-CAM: A Gradient-Free Visual Explanations for Deep Convolutional Network

A Pixel-Level Explainable Approach of Convolutional Neural Networks and Its Application

TSGB: Target-Selective Gradient Backprop for Probing CNN Visual Saliency

Top-Down Neural Attention by Excitation Backprop

Loss-Based Attention for Interpreting Image-Level Prediction of Convolutional Neural Networks.

Deep Learning Methods With the Improved Attention for Explainable Image Recognition

Attention Branch Network: Learning of Attention Mechanism for Visual Explanation

On Fine-Grained Visual Explanation in Convolutional Neural Networks

Recipro-CAM: Fast gradient-free visual explanations for convolutional neural networks

Embedding deep networks into visual explanations

Neuron Abandoning Attention Flow: Visual Explanation of Dynamics inside CNN Models

Towards Robust Visual Explanations for Deep Convolutional Networks with Weight-Wise Perturbations

Towards Visual Explanations for Convolutional Neural Networks via Input Resampling

Cross-CAM: Focused Visual Explanations for Deep Convolutional Networks Via Training-Set Tracing

Explanation vs Attention: A Two-Player Game to Obtain Attention for VQA

Beyond Saliency: Understanding Convolutional Neural Networks from Saliency Prediction on Layer-Wise Relevance Propagation

Salience-CAM: Visual Explanations from Convolutional Neural Networks Via Salience Score

Improving Network Interpretability via Explanation Consistency Evaluation

Multi-attention Guided Activation Propagation in CNNs.