Abstract:Deep learning-based models have been shown to outperform human beings in many computer vision tasks with massive available labeled training data in learning. However, humans have an amazing ability to easily recognize images of novel categories by browsing only a few examples of these categories. In this case, few-shot learning comes into being to make machines learn from extremely limited labeled examples. One possible reason why human beings can well learn novel concepts quickly and efficiently is that they have sufficient visual and semantic prior knowledge. Toward this end, this work proposes a novel knowledge-guided semantic transfer network (KSTNet) for few-shot image recognition from a supplementary perspective by introducing auxiliary prior knowledge. The proposed network jointly incorporates vision inferring, knowledge transferring, and classifier learning into one unified framework for optimal compatibility. A category-guided visual learning module is developed in which a visual classifier is learned based on the feature extractor along with the cosine similarity and contrastive loss optimization. To fully explore prior knowledge of category correlations, a knowledge transfer network is then developed to propagate knowledge information among all categories to learn the semantic-visual mapping, thus inferring a knowledge-based classifier for novel categories from base categories. Finally, we design an adaptive fusion scheme to infer the desired classifiers by effectively integrating the above knowledge and visual information. Extensive experiments are conducted on two widely used Mini-ImageNet and Tiered-ImageNet benchmarks to validate the effectiveness of KSTNet. Compared with the state of the art, the results show that the proposed method achieves favorable performance with minimal bells and whistles, especially in the case of one-shot learning.

Multi-domain few-shot image recognition with knowledge transfer

Knowledge-Based Fine-Grained Classification for Few-Shot Learning.

Domain Mapping Network for Remote Sensing Cross-Domain Few-Shot Classification

Research on a Cross-Domain Few-Shot Adaptive Classification Algorithm Based on Knowledge Distillation Technology

Knowledge Transduction for Cross-Domain Few-Shot Learning

Experiments in cross-domain few-shot learning for image classification

Knowledge-Guided Semantic Transfer Network for Few-Shot Image Recognition

Multi-directional Knowledge Transfer for Few-Shot Learning

Cross-Domain Few-Shot Classification via Learned Feature-Wise Transformation

Knowledge Driven Weights Estimation for Large-scale Few-shot Image Recognition

Dual Adaptive Representation Alignment for Cross-domain Few-shot Learning

Variational Neuron Shifting for Few-Shot Image Classification Across Domains

Attentive fine-grained recognition for cross-domain few-shot classification

Enhancing few-shot lifelong learning through fusion of cross-domain knowledge

Cross-Domain Few-Shot Classification based on Lightweight Res2Net and Flexible GNN

Few-shot Learning for Domain-specific Fine-grained Image Classification

Incremental learning based multi-domain adaptation for object detection

A Multi-Mode Modulator for Multi-Domain Few-Shot Classification

Reasearch on Cross Domain Few-shot Learning Method Based on Local Feature Association

Knowledge Graph Enhanced Multimodal Learning for Few-shot Visual Recognition

Improving the Generalization Ability of Deep Neural Networks for Cross-Domain Visual Recognition