Multi-scale Feature Modification Network for FewShot Image Classification

Yuxiang Chen,Zongqing Lu
DOI: https://doi.org/10.1109/icicml60161.2023.10424955
2023-01-01
Abstract:Few-shot image classification aims to learn a model that can adopt to unseen classes with few labeled data. This challenging problem requires to overcome the distribution shift of features due to differences between the novel classes and the base classes. Inspired by transformer style self-attention mechanism and feature pyramid, we propose a multi-scale cross-attention module. This module enables the correction of features by interacting with feature information at different scales and obtains the feature set of the sample. In addition, from the perspective of metric learning, we further propose a distance metric module to measure the distance between sets of features, thus better characterizing the similarity between samples. Extensive experiments on two public benchmarks in both 1-shot and 5-shot setting demonstrate the effectiveness of our method, which is a significant performance improvement over most methods.
What problem does this paper attempt to address?