Abstract:Deep learning-based models have been shown to outperform human beings in many computer vision tasks with massive available labeled training data in learning. However, humans have an amazing ability to easily recognize images of novel categories by browsing only a few examples of these categories. In this case, few-shot learning comes into being to make machines learn from extremely limited labeled examples. One possible reason why human beings can well learn novel concepts quickly and efficiently is that they have sufficient visual and semantic prior knowledge. Toward this end, this work proposes a novel knowledge-guided semantic transfer network (KSTNet) for few-shot image recognition from a supplementary perspective by introducing auxiliary prior knowledge. The proposed network jointly incorporates vision inferring, knowledge transferring, and classifier learning into one unified framework for optimal compatibility. A category-guided visual learning module is developed in which a visual classifier is learned based on the feature extractor along with the cosine similarity and contrastive loss optimization. To fully explore prior knowledge of category correlations, a knowledge transfer network is then developed to propagate knowledge information among all categories to learn the semantic-visual mapping, thus inferring a knowledge-based classifier for novel categories from base categories. Finally, we design an adaptive fusion scheme to infer the desired classifiers by effectively integrating the above knowledge and visual information. Extensive experiments are conducted on two widely used Mini-ImageNet and Tiered-ImageNet benchmarks to validate the effectiveness of KSTNet. Compared with the state of the art, the results show that the proposed method achieves favorable performance with minimal bells and whistles, especially in the case of one-shot learning.

Superclass-aware network for few-shot learning

Knowledge-Guided Semantic Transfer Network for Few-Shot Image Recognition

AS-Net: Class-Aware Assistance and Suppression Network for Few-Shot Learning

Knowledge-Based Fine-Grained Classification for Few-Shot Learning.

Learning to Propagate Labels: Transductive Propagation Network for Few-shot Learning

Instance-Level Few-Shot Learning With Class Hierarchy Mining

SSL-ProtoNet: Self-supervised Learning Prototypical Networks for few-shot learning

Channel-spatial attention network for fewshot classification

Meta-Learning for Semi-Supervised Few-Shot Classification

Cross Attention Network for Few-shot Classification

Spatial Attention Network for Few-Shot Learning

Few-Shot Object Recognition from Machine-Labeled Web Images.

Efficient Few-Shot Classification Via Contrastive Pretraining on Web Data.

Attribute- and attention-guided few-shot classification

Compositional Prototypical Networks for Few-Shot Classification

Supervised Contrastive Representation Embedding Based on Transformer for Few-Shot Classification

Bimodal semantic fusion prototypical network for few-shot classification

Self-supervised Knowledge Distillation for Few-shot Learning

CSN: Component supervised network for few-shot classification

Learning Class-level Prototypes for Few-shot Learning