Abstract:This study presents a deep learning research aimed at improving the performance of image classification models and increasing interpretability as well. We explore ways to improve the model by combining attention mechanisms with convolutional neural networks. This study uses garbage classification data in public datasets for training in a supervised learning manner, and employs Grad-CAM (Gradient-weighted Class Activation Mapping) with channel attention mechanism SE (Squeeze-and-Excitation) to generate heat maps for better understanding the decision-making process of the model's classification. By using the Grad-CAM function to generate heat maps, it is possible to visualize the areas which the model focuses on during classification. This provides a method to explain the model's classification decisions, allowing us to better understand the basis of the model's decisions on different categories of images. The model is improved by adding attention modules to different stages of the ResNet50 (Residual Network-50) network, thereby improving the accuracy and performance of the network. We notice that within the same stage, the structure and required attention of each module are consistent, so only one attention module is added in each stage to reduce the burden of network learning and speed up learning. In order to simplify the calculation process of attention, a global tensor is introduced to store the attention of each stage, thereby avoiding repeated calculations in each module. The experimental results show that compared with traditional convolutional neural networks, our proposed method achieves better performance on garbage classification tasks. By combining the attention mechanism and heat map interpretation, our model is able to improve classification accuracy. This is of great significance for image classification tasks in practical applications and helps to promote the research progress of deep learning in interpretability.

Loss-Based Attention for Interpreting Image-Level Prediction of Convolutional Neural Networks.

Attention Backpropagation

HAM: Hybrid Attention Module in Deep Convolutional Neural Networks for Image Classification

Deep Learning Methods With the Improved Attention for Explainable Image Recognition

Lossless Attention in Convolutional Networks for Facial Expression Recognition in the Wild

An Attention Module for Convolutional Neural Networks

Fusion Global and Local Deep Representations with Neural Attention for Aesthetic Quality Assessment

Attention Graph: Learning Effective Visual Features for Large-Scale Image Classification

Deep Neural Framework with Visual Attention and Global Context for Predicting Image Aesthetics

Feature-Based Interpretation of Image Classification With the Use of Convolutional Neural Networks

Interpretability Analysis and Attention Mechanism of Deep Learning-Based Microscopic Vision

Deep Features Analysis with Attention Networks

ELA: Efficient Local Attention for Deep Convolutional Neural Networks

Attend and Guide (AG-Net): A Keypoints-driven Attention-based Deep Network for Image Recognition

Interpretable Clinical Prediction Via Attention-Based Neural Network.

Focus Longer to See Better: Recursively Refined Attention for Fine-Grained Image Classification

SCGA‐Net: Skip Connections Global Attention Network for Image Restoration

Delving Into Precise Attention In Image Captioning

Interpreting and Improving Attention From the Perspective of Large Kernel Convolution

Learn to Pay Attention Via Switchable Attention for Image Recognition

A Novel ResNet50-based Attention Mechanism for Image Classification