Abstract:In this paper, we look at cross-domain few-shot classification which presents the challenging task of learning new classes in previously unseen domains with few labelled examples. Existing methods, though somewhat effective, encounter several limitations, which we alleviate through two significant improvements. First, we introduce a lightweight parameter-efficient adaptation strategy to address overfitting associated with fine-tuning a large number of parameters on small datasets. This strategy employs a linear transformation of pre-trained features, significantly reducing the trainable parameter count. Second, we replace the traditional nearest centroid classifier with a discriminative sample-aware loss function, enhancing the model's sensitivity to the inter- and intra-class variances within the training set for improved clustering in feature space. Empirical evaluations on the Meta-Dataset benchmark showcase that our approach not only improves accuracy up to 7.7\% and 5.3\% on previously seen and unseen datasets, respectively, but also achieves the above performance while being at least $\sim3\times$ more parameter-efficient than existing methods, establishing a new state-of-the-art in cross-domain few-shot learning. Our code is available at

What problem does this paper attempt to address?

The problem that this paper attempts to solve is how to use a small amount of labeled data to learn new categories in previously unseen domains in cross - domain few - shot classification tasks. Specifically, although existing methods are effective to a certain extent, they have several limitations: 1. **Over - fitting problem**: Existing methods usually fine - tune a large number of task - specific parameters in the meta - testing stage, which is prone to cause over - fitting in the case of scarce data. 2. **Low efficiency of feature adaptation**: Many existing methods attempt to fine - tune the entire pre - trained model, which increases the risk of over - fitting under limited data conditions. 3. **Insufficient classifier performance**: The traditional nearest centroid classifier (NCC) performs poorly in dealing with intra - class and inter - class differences and may lead to confusion during classification. To solve these problems, this paper proposes two main improvements: 1. **Lightweight and parameter - efficient adaptation strategy**: By introducing a linear transformation of pre - trained features, the number of trainable parameters is significantly reduced, thereby alleviating the over - fitting problem. 2. **Discriminative sample - aware loss function**: It is used to replace the traditional NCC classifier, enhancing the model's sensitivity to intra - class and inter - class differences in the training set and improving the clustering effect in the feature space. These improvements not only increase the accuracy of this method on seen and unseen datasets by 7.7% and 5.3% respectively, but also are at least 3 times more efficient than existing methods, establishing a new benchmark for cross - domain few - shot learning.

Discriminative Sample-Guided and Parameter-Efficient Feature Space Adaptation for Cross-Domain Few-Shot Learning

Feature Transformation for Few-Shot Learning

Adaptive Parametric Prototype Learning for Cross-Domain Few-Shot Classification

Meta-Learning Adversarial Domain Adaptation Network for Few-Shot Text Classification.

Dual Adaptive Representation Alignment for Cross-domain Few-shot Learning

Cross-Domain Few-Shot Classification via Learned Feature-Wise Transformation

Cross-Domain Few-Shot Classification Via Adversarial Task Augmentation

Adaptive Cross-Modal Few-Shot Learning

Cross-Domain Few-Shot Classification via Dense-Sparse-Dense Regularization

Variational Hyperparameter Inference for Few-Shot Learning Across Domains

Instance-Level Embedding Adaptation for Few-Shot Learning

Few-Shot Learning Based on Deep Learning for Image Classification

LDAnet:a Discriminant Subspace for Metric-Based Few-Shot Learning

Reasearch on Cross Domain Few-shot Learning Method Based on Local Feature Association

Task-aware Adaptive Learning for Cross-domain Few-shot Learning

Perspectives of Calibrated Adaptation for Few-shot Cross-domain Classification

Cross-domain Few-Shot Classification Through Feature Confusion

Cross-domain Few-shot Learning with Task-specific Adapters

Variational Neuron Shifting for Few-Shot Image Classification Across Domains

Representative Multi-Domain Feature Selection Based Cross-Domain Few-Shot Classification