Abstract:Deep learning-based models have been shown to outperform human beings in many computer vision tasks with massive available labeled training data in learning. However, humans have an amazing ability to easily recognize images of novel categories by browsing only a few examples of these categories. In this case, few-shot learning comes into being to make machines learn from extremely limited labeled examples. One possible reason why human beings can well learn novel concepts quickly and efficiently is that they have sufficient visual and semantic prior knowledge. Toward this end, this work proposes a novel knowledge-guided semantic transfer network (KSTNet) for few-shot image recognition from a supplementary perspective by introducing auxiliary prior knowledge. The proposed network jointly incorporates vision inferring, knowledge transferring, and classifier learning into one unified framework for optimal compatibility. A category-guided visual learning module is developed in which a visual classifier is learned based on the feature extractor along with the cosine similarity and contrastive loss optimization. To fully explore prior knowledge of category correlations, a knowledge transfer network is then developed to propagate knowledge information among all categories to learn the semantic-visual mapping, thus inferring a knowledge-based classifier for novel categories from base categories. Finally, we design an adaptive fusion scheme to infer the desired classifiers by effectively integrating the above knowledge and visual information. Extensive experiments are conducted on two widely used Mini-ImageNet and Tiered-ImageNet benchmarks to validate the effectiveness of KSTNet. Compared with the state of the art, the results show that the proposed method achieves favorable performance with minimal bells and whistles, especially in the case of one-shot learning.

Knowledge Driven Weights Estimation for Large-scale Few-shot Image Recognition

Knowledge-Guided Semantic Transfer Network for Few-Shot Image Recognition

Knowledge-Based Fine-Grained Classification for Few-Shot Learning.

Multi-domain few-shot image recognition with knowledge transfer

Knowledge Graph Transfer Network for Few-Shot Recognition

Knowledge Graph Enhanced Multimodal Learning for Few-shot Visual Recognition

Large-Scale Few-Shot Learning via Multi-modal Knowledge Discovery

Reweighting and Information-Guidance Networks for Few-Shot Learning

Large-scale few-shot learning: Knowledge transfer with class hierarchy

Multi-directional Knowledge Transfer for Few-Shot Learning

Semantic Enhanced Knowledge Graph for Large-Scale Zero-Shot Learning

RGB-NIR Image Categorization with Prior Knowledge Transfer

Few-shot Image Classification Based on Gradual Machine Learning

Semantic guided knowledge graph for large-scale zero-shot learning

Knowledge Graph Enhancement for Fine-grained Zero-shot Learning on ImageNet21K

Knowledge Transduction for Cross-Domain Few-Shot Learning

Enhancing Few-Shot Learning in Lightweight Models via Dual-Faceted Knowledge Distillation

Improving the Generalised Few-shot Learning by Semantic Information

Cross-Modal Knowledge Distillation For Fine-Grained One-Shot Classification

Exploring Effective Knowledge Transfer for Few-shot Object Detection