Abstract:Few-shot Learning aims to learn and distinguish new categories with a very limited number of available images, presenting a significant challenge in the realm of deep learning. Recent researchers have sought to leverage the additional textual or linguistic information of these rare categories with a pre-trained language model to facilitate learning, thus partially alleviating the problem of insufficient supervision signals. However, the full potential of the textual information and pre-trained language model have been underestimated in the few-shot learning till now, resulting in limited performance enhancements. To address this, we propose a simple but effective framework for few-shot learning tasks, specifically designed to exploit the textual information and language model. In more detail, we explicitly exploit the zero-shot capability of the pre-trained language model with the learnable prompt. And we just add the visual feature with the textual feature for inference directly without the intricate designed fusion modules in previous works. Additionally, we apply the self-ensemble and distillation to further enhance these components. Our extensive experiments conducted across four widely used few-shot datasets demonstrate that our simple framework achieves impressive results. Particularly noteworthy is its outstanding performance in the 1-shot learning task, surpassing state-of-the-art methods by an average of 3.0\% in classification accuracy. \footnote{We will make the source codes of the proposed framework publicly available upon acceptance. }.

Editorial Note: Few-Shot Learning for Multimedia Content Understanding

Editorial Note: Machine Learning for Multimodal Data Understanding

Editorial Note: Binary Representation Learning for Large-scale Multimedia Applications

Editorial Note: Big Multimedia Data in Robotics Applications

Knowledge-Based Fine-Grained Classification for Few-Shot Learning.

Gestalt-Guided Image Understanding for Few-Shot Learning

Few-Shot Adaptation for Multimedia Semantic Indexing

A Closer Look at Few-Shot Video Classification: A New Baseline and Benchmark

Recent Advances of Few-Shot Learning Methods and Applications

Guest Editorial: Representation Learning for Multimedia Data Understanding

Few-shot Learning for Multi-Modality Tasks

Less is More: A Closer Look at Semantic-based Few-Shot Learning

A Review of Few ‐ shot Learning

Diversifying Cross-Domain Few-Shot Learning Via Multimodal Image Editing

A Comprehensive Survey of Few-shot Learning: Evolution, Applications, Challenges, and Opportunities

Collect and Select: Semantic Alignment Metric Learning for Few-Shot Learning

Learning What Not to Segment: A New Perspective on Few-Shot Segmentation

Few-shot Learning for Domain-specific Fine-grained Image Classification

Guest Editorial: Image/video Understanding and Analysis.

Few-Shot Image Classification: Current Status and Research Trends