Abstract:Existing Few-Shot Learning (FSL) methods predominantly focus on developing different types of sophisticated models to extract the transferable prior knowledge for recognizing novel classes, while they almost pay less attention to the feature learning part in FSL which often simply leverage some well-known CNN as the feature learner. However, feature is the core medium for encoding such transferable knowledge. Feature learning is easy to be trapped in the over-fitting particularly in the scarcity of the training data, and thereby degenerates the performances of FSL. The handcrafted features, such as Histogram of Oriented Gradient (HOG) and Local Binary Pattern (LBP), have no requirement on the amount of training data, and used to perform quite well in many small-scale data scenarios, since their extractions involve no learning process, and are mainly based on the empirically observed and summarized prior feature engineering knowledge. In this paper, we intend to develop a general and simple approach for generally boosting FSL via exploiting such prior knowledge in the feature learning phase. To this end, we introduce two novel handcrafted feature regression modules, namely HOG and LBP regression, to the feature learning parts of deep learning-based FSL models. These two modules are separately plugged into the different convolutional layers of backbone based on the characteristics of the corresponding handcrafted features to guide the backbone optimization from different feature granularity, and also ensure that the learned feature can encode the handcrafted feature knowledge which improves the generalization ability of feature and alleviate the over-fitting of the models. Three recent state-of-the-art FSL approaches are leveraged for examining the effectiveness of our method. Extensive experiments on miniImageNet, CIFAR-FS and FC100 datasets show that the performances of all these FSL approaches are well boosted via applying our method on all three datasets. Our codes and models have been released.

Tailoring Embedding Function to Heterogeneous Few-Shot Tasks by Global and Local Feature Adaptors

Local Spatial Alignment Network for Few-Shot Learning

Learning Embedding Adaptation for Few-Shot Learning

CSTS: Exploring Class-Specific and Task-Shared Embedding Representation for Few-Shot Learning

Few-Shot Learning via Embedding Adaptation With Set-to-Set Functions

Hybrid Consistency Training with Prototype Adaptation for Few-Shot Learning

Boosting Generalized Few-Shot Learning by Scattering Intra-class Distribution

Learning to Class-Adaptively Manipulate Embeddings for Few-Shot Learning.

Multimodal-guided Local Feature Selection for Few-shot Learning

Textual Enhanced Adaptive Meta-Fusion for Few-Shot Visual Recognition

Few-shot learning with task adaptation for multi-category gastrointestinal endoscopy classification

TAFSSL: Task-Adaptive Feature Sub-Space Learning for few-shot classification

ENHANCING PROTOTYPICAL FEW-SHOT LEARNING BY LEVERAGING THE LOCAL-LEVEL STRATEGY

Balancing Feature Alignment and Uniformity for Few-Shot Classification.

Few-Shot Learning With Global Class Representations

An Adaptive Plug-and-Play Network for Few-Shot Learning

Learning task-specific discriminative embeddings for few-shot image classification

MHFC: Multi-Head Feature Collaboration for Few-Shot Learning

Adaptive Feature Representation Based on Contrastive Learning for Few-Shot Classification

Few-Shot Model Adaptation for Customized Facial Landmark Detection, Segmentation, Stylization and Shadow Removal

Generally Boosting Few-Shot Learning with Hand Crafted Features