Abstract:The effectiveness of metric-based few-shot learning methods heavily relies on the discriminative ability of the prototypes and feature embeddings of queries. However, using instance-level unimodal prototypes often falls short in capturing the essence of various categories. To this end, we propose a multimodal variational contrastive learning framework that aims to enhance prototype representativeness and refine the discrimination of query features by acquiring distribution-level representations. Our approach starts by training a variational auto-encoder through supervised contrastive learning in both the visual and semantic spaces. The trained model is employed to augment the support set by sampling features from the learned semantic distributions and generate pseudo-semantics for queries to achieve information balance across samples in both the support and query sets. Furthermore, we establish a multimodal instance-to-distribution model that learns to transform instance-level multimodal features into distribution-level representations via variational inference, facilitating robust metric. Experiments show that our MVC consistently brings between 0.5 and 7 improvement in accuracy over state-of-the-art methods on standard few-shot learning datasets like miniImageNet, CIFAR-FS, tieredImageNet, and CUB, demonstrating the superiority of our method in terms of classification performance and robustness. The source code is available at: https://github.com/pmhDL/MVC.git.

Enhancing Few-Shot Classification without Forgetting through Multi-Level Contrastive Constraints

Few-Shot Classification with Contrastive Learning

Adaptive Feature Representation Based on Contrastive Learning for Few-Shot Classification

Boosting Few-Shot Classification with View-Learnable Contrastive Learning

Multi-Granularity Episodic Contrastive Learning for Few-Shot Learning

SPContrastNet: A Self-Paced Contrastive Learning Model for Few-Shot Text Classification

Auto-view Contrastive Learning for Few-Shot Image Recognition

Contrastive Knowledge-Augmented Self-Distillation Approach for Few-Shot Learning

ContrastNet: A Contrastive Learning Framework for Few-Shot Text Classification

Supervised Contrastive Learning for Few-Shot Action Classification

Multimodal variational contrastive learning for few-shot classification

MetaCL: a semi-supervised meta learning architecture via contrastive learning

Multi-Scale Metric Learning for Few-Shot Learning

Confusable Learning for Large-class Few-Shot Classification

MCML: A Novel Memory-based Contrastive Meta-Learning Method for Few Shot Slot Tagging

A Transfer-Based Few-Shot Classification Approach Via Masked Manifold Mixup and Fuzzy Memory Contrastive Learning.

Learning to focus: cascaded feature matching network for few-shot image recognition

Hybrid Contrastive Prototypical Network for Few-Shot Scene Classification

Momentum Memory Contrastive Learning for Transfer-Based Few-Shot Classification

Label-template based Few-Shot Text Classification with Contrastive Learning

Enhancing Few-shot Classification Through Token Selection for Balanced Learning