Abstract:In order to quickly adapt to new data, few-shot learning aims at learning from few examples, often by using already acquired knowledge. The new data often differs from the previously seen data due to a domain shift, that is, a change of the input-target distribution. While several methods perform well on small domain shifts like new target classes with similar inputs, larger domain shifts are still challenging. Large domain shifts may result in high-level concepts that are not shared between the original and the new domain, whereas low-level concepts like edges in images might still be shared and useful. For cross-domain few-shot learning, we suggest representation fusion to unify different abstraction levels of a deep neural network into one representation. We propose Cross-domain Hebbian Ensemble Few-shot learning (CHEF), which achieves representation fusion by an ensemble of Hebbian learners acting on different layers of a deep neural network. Ablation studies show that representation fusion is a decisive factor to boost cross-domain few-shot learning. On the few-shot datasets miniImagenet and tieredImagenet with small domain shifts, CHEF is competitive with state-of-the-art methods. On cross-domain few-shot benchmark challenges with larger domain shifts, CHEF establishes novel state-of-the-art results in all categories. We further apply CHEF on a real-world cross-domain application in drug discovery. We consider a domain shift from bioactive molecules to environmental chemicals and drugs with twelve associated toxicity prediction tasks. On these tasks, that are highly relevant for computational drug discovery, CHEF significantly outperforms all its competitors. Github: <a class="link-external link-https" href="https://github.com/ml-jku/chef" rel="external noopener nofollow">this https URL</a>

Cross-domain few-shot learning via adaptive transformer networks

Cross-Domain Few-Shot Learning via Adaptive Transformer Networks

Target Oriented Dynamic Adaption for Cross-Domain Few-Shot Learning

Adaptive Parametric Prototype Learning for Cross-Domain Few-Shot Classification

Cross-Domain Few-Shot Classification Via Adversarial Task Augmentation

Dual Adaptive Representation Alignment for Cross-domain Few-shot Learning

Leveraging Normalization Layer in Adapters With Progressive Learning and Adaptive Distillation for Cross-Domain Few-Shot Learning

Few-shot Hybrid Domain Adaptation of Image Generator

Meta-Learning Adversarial Domain Adaptation Network for Few-Shot Text Classification.

Learning Embedding Adaptation for Few-Shot Learning

Cross-domain Few-Shot Classification Through Feature Confusion

Learning cross-domain representations by vision transformer for unsupervised domain adaptation

Few-Shot Learning via Embedding Adaptation With Set-to-Set Functions

Cross-Domain Few-Shot Learning by Representation Fusion

Domain-Adaptive Few-Shot Learning

Cross-Domain Few-Shot Classification via Learned Feature-Wise Transformation

Discriminative Sample-Guided and Parameter-Efficient Feature Space Adaptation for Cross-Domain Few-Shot Learning

Convert Cross-Domain Classification into Few-Shot Learning: A Unified Prompt-Tuning Framework for Unsupervised Domain Adaptation

CDTrans: Cross-domain Transformer for Unsupervised Domain Adaptation

Adapt Before Comparison: A New Perspective on Cross-Domain Few-Shot Segmentation

Cross-Domain Few-Shot Segmentation via Iterative Support-Query Correspondence Mining