Semantic-Based Implicit Feature Transform for Few-Shot Classification

Mei-Hong Pan,Hong-Yi Xin,Hong-Bin Shen
DOI: https://doi.org/10.1007/s11263-024-02113-8
IF: 13.369
2024-01-01
International Journal of Computer Vision
Abstract:Few-shot learning aims to recognize instances from previously unseen classes based on a very limited number of examples. However, models often face the challenge of overfitting due to the biased distribution computed from extremely scarce training data. This work proposes a Semantic-based Implicit Feature Transform (SIFT) method to implicitly generate high-quality features for few-shot learning tasks. In this method, we employ an encode-transform-decode pipeline to facilitate the direct transfer of feature instances from base classes to novel classes via semantic transformation, ensuring the generation of semantically meaningful features. Additionally, a compactness constraint is imposed on the generated features, with novel class prototypes serving as anchors, to ensure that the features are distributed around the class centers. Furthermore, we integrate the cluster centers of the query set with the initial prototypes computed from the support set to produce less biased class prototypes, which can serve as better anchors for feature reconstruction. The experimental results reveal that our method outperforms the baselines by substantial margins and achieves state-of-the-art few-shot classification performance on the miniImageNet and CIFAR-FS datasets in both inductive and transductive settings, demonstrating the superiority of our method. Furthermore, the comprehensive ablation studies provide additional validation of its effectiveness. The code is available at: https://github.com/pmhDL/SIFT.git .
What problem does this paper attempt to address?