Abstract:The vanilla Few-shot Learning (FSL) learns to build a classifier for a new concept from one or very few target examples, with the general assumption that source and target classes are sampled from the same domain. Recently, the task of Cross-Domain Few-Shot Learning (CD-FSL) aims at tackling the FSL where there is a huge domain shift between the source and target datasets. Extensive efforts on CD-FSL have been made via either directly extending the meta-learning paradigm of vanilla FSL methods, or employing massive unlabeled target data to help learn models. In this paper, we notice that in the CD-FSL task, the few labeled target images have never been explicitly leveraged to inform the model in the training stage. However, such a labeled target example set is very important to bridge the huge domain gap. Critically, this paper advocates a more practical training scenario for CD-FSL. And our key insight is to utilize a few labeled target data to guide the learning of the CD-FSL model. Technically, we propose a novel Generalized Meta-learning based Feature-Disentangled Mixup network, namely GMeta-FDMixup. We make three key contributions of utilizing GMeta-FDMixup to address CD-FSL. Firstly, we present two mixup modules - mixup-P and mixup-M that help facilitate utilizing the unbalanced and disjoint source and target datasets. These two novel modules enable diverse image generation for training the model on the source domain. Secondly, to narrow the domain gap explicitly, we contribute a novel feature disentanglement module that learns to decouple the domain-irrelevant and domain-specific features. By stripping the domain-specific features, we alleviate the negative effects caused by the domain inductive bias. Finally, we repurpose a new contrastive learning module, dubbed ConL. ConL prevents the model from only capturing category-related features via introducing contrastive loss. Thus, the generalization ability on novel categories is improved. Extensive experimental results on two benchmarks show the superiority of our setting and the effectiveness of our method. Code and models will be released.

Few-Shot Domain Adaptation via Mixup Optimal Transport

Uncertainty-guided Joint Unbalanced Optimal Transport for Unsupervised Domain Adaptation

HOMDA: High-Order Moment-Based Domain Alignment for Unsupervised Domain Adaptation

Spectral Adversarial MixUp for Few-Shot Unsupervised Domain Adaptation

Low-Rank Optimal Transport for Robust Domain Adaptation

TGDM: Target Guided Dynamic Mixup for Cross-Domain Few-Shot Learning

Optimal Transport for Domain Adaptation through Gaussian Mixture Models

Few-shot Adaptation to Distribution Shifts By Mixing Source and Target Embeddings

Few-shot Hybrid Domain Adaptation of Image Generator

Cross-Domain Few-Shot Classification Via Adversarial Task Augmentation

Source-free semi-supervised domain adaptation via progressive Mixup

Uncertainty-Guided Mixup for Semi-Supervised Domain Adaptation without Source Data.

Generalized Meta-FDMixup: Cross-Domain Few-Shot Learning Guided by Labeled Target Data

A Class-aware Optimal Transport Approach with Higher-Order Moment Matching for Unsupervised Domain Adaptation

Reliable Weighted Optimal Transport For Unsupervised Domain Adaptation

Variational Neuron Shifting for Few-Shot Image Classification Across Domains

Decomposed-distance weighted optimal transport for unsupervised domain adaptation

Aggregating Randomized Clustering-Promoting Invariant Projections for Domain Adaptation

Joint Distribution Optimal Transportation for Domain Adaptation

Toward few-shot domain adaptation with perturbation-invariant representation and transferable prototypes

Target Oriented Dynamic Adaption for Cross-Domain Few-Shot Learning