Abstract:Few-shot learning (FSL) aims to recognize novel classes with few examples. Pre-training based methods effectively tackle the problem by pre-training a feature extractor and then fine-tuning it through the nearest centroid based meta-learning. However, results show that the fine-tuning step makes marginal improvements. In this paper, 1) we figure out the reason, i.e., in the pre-trained feature space, the base classes already form compact clusters while novel classes spread as groups with large variances, which implies that fine-tuning feature extractor is less meaningful; 2) instead of fine-tuning feature extractor, we focus on estimating more representative prototypes. Consequently, we propose a novel prototype completion based meta-learning framework. This framework first introduces primitive knowledge (i.e., class-level part or attribute annotations) and extracts representative features for seen attributes as priors. Second, a part/attribute transfer network is designed to learn to infer the representative features for unseen attributes as supplementary priors. Finally, a prototype completion network is devised to learn to complete prototypes with these priors. Moreover, to avoid the prototype completion error, we further develop a Gaussian based prototype fusion strategy that fuses the mean-based and completed prototypes by exploiting the unlabeled samples. At last, we also develop an economic prototype completion version for FSL, which does not need to collect primitive knowledge, for a fair comparison with existing FSL methods without external knowledge. Extensive experiments show that our method: (i) obtains more accurate prototypes; (ii) achieves superior performance on both inductive and transductive FSL settings. Our codes are open-sourced at https://github.com/zhangbq-research/Prototype_Completion_for_FSL.

Task-aware prototype refinement for improved few-shot learning

Feature Transformation for Few-Shot Learning

Adaptive Parametric Prototype Learning for Cross-Domain Few-Shot Classification

Task-Agnostic Self-Distillation for Few-Shot Action Recognition

Prototype Completion for Few-Shot Learning

ProtoRefine: Enhancing Prototypes with Similar Structure in Few-Shot Learning

TART: Improved Few-shot Text Classification Using Task-Adaptive Reference Transformation

Transductive Episodic-Wise Adaptive Metric for Few-Shot Learning

Transductive Few-shot Learning with Prototype-based Label Propagation by Iterative Graph Refinement

Prototype Rectification with Region-Wise Foreground Enhancement for Few-Shot Classification.

Learning to Propagate Labels: Transductive Propagation Network for Few-shot Learning

PrototypeFormer: Learning to Explore Prototype Relationships for Few-shot Image Classification

TapNet: Neural Network Augmented with Task-Adaptive Projection for Few-Shot Learning

Few-shot Action Recognition with Prototype-centered Attentive Learning

Task-Adapter: Task-specific Adaptation of Image Models for Few-shot Action Recognition

Adaptive Fine-Tuning Strategy for Few-Shot Learning

Learning Class-level Prototypes for Few-shot Learning

Trainable Class Prototypes for Few-Shot Learning

TADAM: Task dependent adaptive metric for improved few-shot learning

Task Encoding with Distribution Calibration for Few-Shot Learning

Prototype Refinement Network for Few-Shot Segmentation