Abstract:Humans exhibit remarkable proficiency in visual classification tasks, accurately recognizing and classifying new images with minimal examples. This ability is attributed to their capacity to focus on details and identify common features between previously seen and new images. In contrast, existing few-shot image classification methods often emphasize either global features or local features, with few studies considering the integration of both. To address this limitation, we propose a novel approach based on the Siamese Transformer Network (STN). Our method employs two parallel branch networks utilizing the pre-trained Vision Transformer (ViT) architecture to extract global and local features, respectively. Specifically, we implement the ViT-Small network architecture and initialize the branch networks with pre-trained model parameters obtained through self-supervised learning. We apply the Euclidean distance measure to the global features and the Kullback-Leibler (KL) divergence measure to the local features. To integrate the two metrics, we first employ L2 normalization and then weight the normalized results to obtain the final similarity score. This strategy leverages the advantages of both global and local features while ensuring their complementary benefits. During the training phase, we adopt a meta-learning approach to fine-tune the entire network. Our strategy effectively harnesses the potential of global and local features in few-shot image classification, circumventing the need for complex feature adaptation modules and enhancing the model's generalization ability. Extensive experiments demonstrate that our framework is simple yet effective, achieving superior performance compared to state-of-the-art baselines on four popular few-shot classification benchmarks in both 5-shot and 1-shot scenarios.

Adaptive multi-scale transductive information propagation for few-shot learning

Learning to Propagate Labels: Transductive Propagation Network for Few-shot Learning

Feature Transformation for Few-Shot Learning

Adaptive Anchor Label Propagation for Transductive Few-Shot Learning

Ensemble Transductive Propagation Network for Semi-Supervised Few-Shot Learning

Multi-scale Feature Modification Network for FewShot Image Classification

Learning to focus: cascaded feature matching network for few-shot image recognition

Multi-Scale Adaptive Task Attention Network for Few-Shot Learning.

Multi-level adaptive few-shot learning network combined with vision transformer

Siamese Transformer Networks for Few-shot Image Classification

Transductive Relation-Propagation With Decoupling Training for Few-Shot Learning

Attention Enhanced Multi-Scale Feature Map Fusion Few Shot Learning

Multi-scale fusion for few-shot remote sensing image classification

Transductive Few-shot Learning with Prototype-based Label Propagation by Iterative Graph Refinement

Transductive Episodic-Wise Adaptive Metric for Few-Shot Learning

Local descriptor-based multi-prototype network for few-shot Learning

MPF-Net: multi-projection filtering network for few-shot object detection

A Two-Stream Network with Image-to-Class Deep Metric for Few-Shot Classification.

Local Feature Semantic Alignment Network for Few-Shot Image Classification

Bidirectional Matching Prototypical Network for Few-Shot Image Classification

Multi-attention mutual information distributed framework for few-shot learning