Abstract:Deep learning models have yielded impressive results in many tasks. However, the success hinges on the availability of a large number of labeled samples for model training, and deep learning models tend to perform poorly in scenarios where labeled samples are scarce. In recent years, few-shot learning（FSL） has been proposed to study how to learn quickly from a small number of samples and has achieved good performance mainly by the use of meta-learning for model training. Nevertheless, two issues exist: 1) Existing FSL methods usually manage to recognize novel classes solely with the visual features of samples, without integrating information from other modalities.2) By following the paradigm of meta-learning, a model aims at learning generic and transferable knowledge from massive similar fewshot tasks, which inevitably leads to a generalized feature space and insufficient and inaccurate representation of sample features. To tackle the two issues, this study introduces pre-training and multimodal learning techniques into the FSL process and proposes a new multimodalguided local feature selection strategy for few-shot learning. Specifically, model pre-training is first conducted on known classes with abundant samples to greatly improve the feature representation ability of the model. Then, in the meta-learning stage, the pre-trained model is further optimized by meta-learning to improve its transferability or its adaptability to the few-shot environment. Meanwhile, the local feature selection is carried out on the basis of visual features and textual features of samples to enhance the ability to represent sample features and avoid sharp degradation of the model’s representation ability. Finally, the resultant sample features are utilized for FSL. The experiments on three benchmark datasets, namely, MiniImageNet, CIFAR-FS, and FC-100, demonstrate that the proposed FSL method can achieve better results.

Multi-Attention Based Visual-Semantic Interaction for Few-Shot Learning

SpatialFormer: Semantic and Target Aware Attentions for Few-Shot Learning

Semantic-based Selection, Synthesis, and Supervision for Few-shot Learning

Collect and Select: Semantic Alignment Metric Learning for Few-Shot Learning

Local Spatial Alignment Network for Few-Shot Learning

VSA: Adaptive Visual and Semantic Guided Attention on Few-Shot Learning

Few-Shot Object Detection with Multi-level Information Interaction for Optical Remote Sensing Images

Envisioning Class Entity Reasoning by Large Language Models for Few-shot Learning

Multi-Similarity Enhancement Network for Few-Shot Segmentation.

Few-Shot Multi-Agent Perception with Ranking-Based Feature Learning.

Attention-Based Multi-View Feature Collaboration for Decoupled Few-Shot Learning

Few-Shot Multi-Agent Perception.

Textual Enhanced Adaptive Meta-Fusion for Few-Shot Visual Recognition

Ensembling Multi-View Discriminative Semantic Feature for Few-Shot Classification

Learning Primitive-aware Discriminative Representations for Few-shot Learning

Multi‐task Few‐shot Learning with Composed Data Augmentation for Image Classification

Multimodal-guided Local Feature Selection for Few-shot Learning

Making Large Vision Language Models to be Good Few-shot Learners

Harnessing Multi-Semantic Hypergraph for Few-Shot Learning.

Attention-optimized vision-enhanced prompt learning for few-shot multi-modal sentiment analysis

Knowledge Graph Enhanced Multimodal Learning for Few-shot Visual Recognition