Abstract:Deep learning models have yielded impressive results in many tasks. However, the success hinges on the availability of a large number of labeled samples for model training, and deep learning models tend to perform poorly in scenarios where labeled samples are scarce. In recent years, few-shot learning（FSL） has been proposed to study how to learn quickly from a small number of samples and has achieved good performance mainly by the use of meta-learning for model training. Nevertheless, two issues exist: 1) Existing FSL methods usually manage to recognize novel classes solely with the visual features of samples, without integrating information from other modalities.2) By following the paradigm of meta-learning, a model aims at learning generic and transferable knowledge from massive similar fewshot tasks, which inevitably leads to a generalized feature space and insufficient and inaccurate representation of sample features. To tackle the two issues, this study introduces pre-training and multimodal learning techniques into the FSL process and proposes a new multimodalguided local feature selection strategy for few-shot learning. Specifically, model pre-training is first conducted on known classes with abundant samples to greatly improve the feature representation ability of the model. Then, in the meta-learning stage, the pre-trained model is further optimized by meta-learning to improve its transferability or its adaptability to the few-shot environment. Meanwhile, the local feature selection is carried out on the basis of visual features and textual features of samples to enhance the ability to represent sample features and avoid sharp degradation of the model’s representation ability. Finally, the resultant sample features are utilized for FSL. The experiments on three benchmark datasets, namely, MiniImageNet, CIFAR-FS, and FC-100, demonstrate that the proposed FSL method can achieve better results.

Learning more discriminative local descriptors with parameter-free weighted attention for few-shot learning

Local Descriptors Weighted Adaptive Threshold Filtering For Few-Shot Learning

Local descriptor-based spatial cross attention network for few-shot learning

Feature Aligning Few shot Learning Method Using Local Descriptors Weighted Rules

Revisiting Local Descriptor Based Image-To-Class Measure for Few-Shot Learning

LGSim: local task-invariant and global task-specific similarity for few-shot classification

Adaptive Feature Representation Based on Contrastive Learning for Few-Shot Classification

Imposing Semantic Consistency of Local Descriptors for Few-Shot Learning

Few-Shot Learning Via Task-Aware Discriminant Local Descriptors Network

A Simple Task-aware Contrastive Local Descriptor Selection Strategy for Few-shot Learning between inter class and intra class

Local Spatial Alignment Network for Few-Shot Learning

In defense of local descriptor-based few-shot object detection

A Few-Shot Fine-Grained Image Classification Method Leveraging Global and Local Structures

LDCA: Local Descriptors with Contextual Augmentation for Few-Shot Learning

Spatial Attention Network for Few-Shot Learning

Few-Shot Learning Based on Deep Learning for Image Classification

Representative local feature mining for few-shot learning

Revisiting Local Descriptor for Improved Few-Shot Classification

Unleash the Power of Local Representations for Few-Shot Classification

Multimodal-guided Local Feature Selection for Few-shot Learning

Autonomous Perception and Adaptive Standardization for Few-Shot Learning