Abstract:Deep learning models have yielded impressive results in many tasks. However, the success hinges on the availability of a large number of labeled samples for model training, and deep learning models tend to perform poorly in scenarios where labeled samples are scarce. In recent years, few-shot learning（FSL） has been proposed to study how to learn quickly from a small number of samples and has achieved good performance mainly by the use of meta-learning for model training. Nevertheless, two issues exist: 1) Existing FSL methods usually manage to recognize novel classes solely with the visual features of samples, without integrating information from other modalities.2) By following the paradigm of meta-learning, a model aims at learning generic and transferable knowledge from massive similar fewshot tasks, which inevitably leads to a generalized feature space and insufficient and inaccurate representation of sample features. To tackle the two issues, this study introduces pre-training and multimodal learning techniques into the FSL process and proposes a new multimodalguided local feature selection strategy for few-shot learning. Specifically, model pre-training is first conducted on known classes with abundant samples to greatly improve the feature representation ability of the model. Then, in the meta-learning stage, the pre-trained model is further optimized by meta-learning to improve its transferability or its adaptability to the few-shot environment. Meanwhile, the local feature selection is carried out on the basis of visual features and textual features of samples to enhance the ability to represent sample features and avoid sharp degradation of the model’s representation ability. Finally, the resultant sample features are utilized for FSL. The experiments on three benchmark datasets, namely, MiniImageNet, CIFAR-FS, and FC-100, demonstrate that the proposed FSL method can achieve better results.

DMH-FSL: Dual-Modal Hypergraph for Few-Shot Learning

Harnessing Multi-Semantic Hypergraph for Few-Shot Learning.

Multi-Semantic Hypergraph Neural Network for Effective Few-Shot Learning

MHFC: Multi-Head Feature Collaboration for Few-Shot Learning

Multistage Relation Network with Dual-Metric for Few-Shot Hyperspectral Image Classification

Graph-Based Deep Multitask Few-Shot Learning for Hyperspectral Image Classification

Dual-stream Multi-Modal Graph Neural Network for Few-Shot Learning

Co-Learning for Few-Shot Learning

MDFM: Multi-Decision Fusing Model for Few-Shot Learning

Knowledge Graph Enhanced Multimodal Learning for Few-shot Visual Recognition

A Difference Measuring Network for Few-Shot Learning.

DMN4: Few-shot Learning Via Discriminative Mutual Nearest Neighbor Neural Network

Multimodal-guided Local Feature Selection for Few-shot Learning

Balancing Feature Alignment and Uniformity for Few-Shot Classification.

ML-FDA: Meta-Learning via Feature Distribution Alignment for Few-Shot Learning

vMF Loss: Exploring a Scattered Intra-class Hypersphere for Few-Shot Learning

Few-Shot Learning with Class-Covariance Metric for Hyperspectral Image Classification.

Multi-directional Knowledge Transfer for Few-Shot Learning

Hierarchical Few-Shot Learning with Feature Fusion Driven by Data and Knowledge.

Leveraging Bilateral Correlations for Multi-Label Few-Shot Learning

Multi-Scale Metric Learning for Few-Shot Learning