Abstract:Local-feature-based Few-Shot Learning (FSL) has attracked a lot of attention and achieved great progress recently. Given an image, the model extracts a group of local features through the Fully Convolutional Network (FCN), each of which contains information from the corresponding receptive field of the image. The challenging problem is that how to exploit the local-feature-level similarities to generate the image-level similarity. Towards this, many existing works have proposed different heuristic rules or settings. In this paper, we first follow existing works and systematically propose several modified methods for local feature matching, induced by a novel and improved heterogeneous matching mechanism. However, these heuristic methods are not optimal to highlight the most informative local feature pairs to represent the image-level similarity, and also can not generalize well to different tasks. Therefore, we propose a new idea called Sinkhorn Metrics (SM). We consider the local-feature-based FSL as the Regularized Optimal Transport (ROT) problem. The cost matrix is formed by the similarities of local feature pairs. The marginals indicating the importance of each local feature are obtained by a new attentive cross-comparison module. The optimal transportation plan is used as weights to aggregate all the local-feature-level similarities to obtain the image-level similarity. We exploit the Sinkhorn algorithm to solve the ROT problem, which is efficient for the end-to-end training. We conduct a hybrid experiment on SM with some heuristic baselines to demonstrate its compatibility. Extensive ablation studies are performed to fully evaluate important hyper-parameters and settings. Our method achieves a series of state-of-the-arts on multiple datasets in both the single-domain and cross-domain FSL scenarios (The code for evaluation, trained model, and datasets in this study are available at https://github.com/Wangduo428/few-shot-learning-SM).

An Enhanced Span-based Decomposition Method for Few-Shot Sequence Labeling

Local Spatial Alignment Network for Few-Shot Learning

Unifying Token and Span Level Supervisions for Few-Shot Sequence Labeling

ESPT: A Self-Supervised Episodic Spatial Pretext Task for Improving Few-Shot Learning

Decomposed Meta-Learning for Few-Shot Sequence Labeling

Span-based few-shot event detection via aligning external knowledge

Few-shot Defect Recognition of Metal Surfaces Via Attention-Embedding and Self-Supervised Learning

Adaptive FSS: A Novel Few-Shot Segmentation Framework Via Prototype Enhancement

MDFM: Multi-Decision Fusing Model for Few-Shot Learning

Label-Efficient Few-Shot Semantic Segmentation with Unsupervised Meta-Training

TAFSSL: Task-Adaptive Feature Sub-Space Learning for few-shot classification

Semi-Supervised Few-Shot Classification With Multitask Learning and Iterative Label Correction

Global Span Semantic Dependency Awareness and Filtering Network for nested named entity recognition

Mining Latent Classes for Few-shot Segmentation

Hybrid Multi-stage Decoding for Few-shot NER with Entity-aware Contrastive Learning

Boosting Few-Shot Learning with Task-Adaptive Multi-level Mixed Supervision.

CLLMFS: A Contrastive Learning enhanced Large Language Model Framework for Few-Shot Named Entity Recognition

Layer-Wise Feature Metric of Semantic-Pixel Matching for Few-Shot Learning

Improved local-feature-based few-shot learning with Sinkhorn metrics

EFTNet: an efficient fine-tuning method for few-shot segmentation

Decomposed Meta-Learning for Few-Shot Named Entity Recognition