Abstract:Existing Few-Shot Learning (FSL) methods predominantly focus on developing different types of sophisticated models to extract the transferable prior knowledge for recognizing novel classes, while they almost pay less attention to the feature learning part in FSL which often simply leverage some well-known CNN as the feature learner. However, feature is the core medium for encoding such transferable knowledge. Feature learning is easy to be trapped in the over-fitting particularly in the scarcity of the training data, and thereby degenerates the performances of FSL. The handcrafted features, such as Histogram of Oriented Gradient (HOG) and Local Binary Pattern (LBP), have no requirement on the amount of training data, and used to perform quite well in many small-scale data scenarios, since their extractions involve no learning process, and are mainly based on the empirically observed and summarized prior feature engineering knowledge. In this paper, we intend to develop a general and simple approach for generally boosting FSL via exploiting such prior knowledge in the feature learning phase. To this end, we introduce two novel handcrafted feature regression modules, namely HOG and LBP regression, to the feature learning parts of deep learning-based FSL models. These two modules are separately plugged into the different convolutional layers of backbone based on the characteristics of the corresponding handcrafted features to guide the backbone optimization from different feature granularity, and also ensure that the learned feature can encode the handcrafted feature knowledge which improves the generalization ability of feature and alleviate the over-fitting of the models. Three recent state-of-the-art FSL approaches are leveraged for examining the effectiveness of our method. Extensive experiments on miniImageNet, CIFAR-FS and FC100 datasets show that the performances of all these FSL approaches are well boosted via applying our method on all three datasets. Our codes and models have been released.

Evaluating the Utility of Hand-crafted Features in Sequence Labelling

Citation Metadata Extraction Via Deep Neural Network-based Segment Sequence Labeling

Combining Discrete and Neural Features for Sequence Labeling

Empower Sequence Labeling with Task-Aware Neural Language Model

End-to-end Sequence Labeling via Bi-directional LSTM-CNNs-CRF

Leveraging Sentence-level Information with Encoder LSTM for Semantic Slot Filling

Improving Feature Extraction Using a Hybrid of CNN and LSTM for Entity Identification

BE-BLC: BERT-ELMO-Based Deep Neural Network Architecture for English Named Entity Recognition Task

Generally Boosting Few-Shot Learning with HandCrafted Features

Using Large Language Model for End-to-End Chinese ASR and NER

Towards Improving Neural Named Entity Recognition with Gazetteers

F-Score Driven Max Margin Neural Network for Named Entity Recognition in Chinese Social Media

Leveraging Document-Level Label Consistency for Named Entity Recognition

Chinese Named Entity Recognition with the Improved Smoothed Conditional Random Fields

Enhancing Reinforcement Learning with Label-Sensitive Reward for Natural Language Understanding

Named Entity Recognition with Bidirectional LSTM-CNNs

Character-Level Feature Extraction with Densely Connected Networks

Enhancing Low-resource Fine-grained Named Entity Recognition by Leveraging Coarse-grained Datasets

Deep Encodings vs. Linguistic Features in Lexical Complexity Prediction

Using Chinese Glyphs for Named Entity Recognition

Cascaded Models for Better Fine-Grained Named Entity Recognition