A Fine-grained Image Classification Algorithm Using Knowledge Distillation and Attention Mechanism

Hao Feng,Ying Liu,Weidong Zhang
DOI: https://doi.org/10.1145/3641584.3641612
2024-01-01
Abstract:Fine-grained image classification aims to classify subcategory images with large intra-class differences and small inter-class differences, and thus how to improve recognition of the detailed image information by neural network models has become a focus of scholars' research. In this paper, we used a knowledge distillation strategy based on the attention mechanism and receptive field theory to weight the feature maps of different convolutional layers and improve the recognition ability of the student models for fine-grained information. We experimentally determine the effect of embedding different locations and numbers of attention units into the student model. The experimental results show that double weighting of the channel and spatial domains of the shallow feature maps can improve the network model's ability to perceive detailed image information and improve fine-grained image classification performance.
What problem does this paper attempt to address?