Abstract:This study presents a deep learning research aimed at improving the performance of image classification models and increasing interpretability as well. We explore ways to improve the model by combining attention mechanisms with convolutional neural networks. This study uses garbage classification data in public datasets for training in a supervised learning manner, and employs Grad-CAM (Gradient-weighted Class Activation Mapping) with channel attention mechanism SE (Squeeze-and-Excitation) to generate heat maps for better understanding the decision-making process of the model's classification. By using the Grad-CAM function to generate heat maps, it is possible to visualize the areas which the model focuses on during classification. This provides a method to explain the model's classification decisions, allowing us to better understand the basis of the model's decisions on different categories of images. The model is improved by adding attention modules to different stages of the ResNet50 (Residual Network-50) network, thereby improving the accuracy and performance of the network. We notice that within the same stage, the structure and required attention of each module are consistent, so only one attention module is added in each stage to reduce the burden of network learning and speed up learning. In order to simplify the calculation process of attention, a global tensor is introduced to store the attention of each stage, thereby avoiding repeated calculations in each module. The experimental results show that compared with traditional convolutional neural networks, our proposed method achieves better performance on garbage classification tasks. By combining the attention mechanism and heat map interpretation, our model is able to improve classification accuracy. This is of great significance for image classification tasks in practical applications and helps to promote the research progress of deep learning in interpretability.

Deep Learning Methods With the Improved Attention for Explainable Image Recognition

Exclusive Feature Constrained Class Activation Mapping for Better Visual Explanation.

A Pixel-Level Explainable Approach of Convolutional Neural Networks and Its Application

Attention Backpropagation

Where is the Model Looking At?--Concentrate and Explain the Network Attention

Loss-Based Attention for Interpreting Image-Level Prediction of Convolutional Neural Networks.

Deep Features Analysis with Attention Networks

Explaining Deep Convolutional Neural Networks for Image Classification by Evolving Local Interpretable Model-agnostic Explanations

HAM: Hybrid Attention Module in Deep Convolutional Neural Networks for Image Classification

Attention Graph: Learning Effective Visual Features for Large-Scale Image Classification

Explainable Image Recognition via Enhanced Slot-attention Based Classifier

Improving Network Interpretability via Explanation Consistency Evaluation

Deeper Interpretability of Deep Networks

Depth-Wise Separable Convolution Attention Module for Garbage Image Classification

From Heatmaps to Structural Explanations of Image Classifiers

Enhancing the confidence of deep learning classifiers via interpretable saliency maps

Accurate Explanation Model for Image Classifiers using Class Association Embedding

Leveraging Attention-Based Visual Clue Extraction for Image Classification

Leveraging saliency priors and explanations for enhanced consistent interpretability

Attention Branch Network: Learning of Attention Mechanism for Visual Explanation

Research on image classification based on residual group multi-scale enhanced attention network