Abstract:Deep learning-based models have been shown to outperform human beings in many computer vision tasks with massive available labeled training data in learning. However, humans have an amazing ability to easily recognize images of novel categories by browsing only a few examples of these categories. In this case, few-shot learning comes into being to make machines learn from extremely limited labeled examples. One possible reason why human beings can well learn novel concepts quickly and efficiently is that they have sufficient visual and semantic prior knowledge. Toward this end, this work proposes a novel knowledge-guided semantic transfer network (KSTNet) for few-shot image recognition from a supplementary perspective by introducing auxiliary prior knowledge. The proposed network jointly incorporates vision inferring, knowledge transferring, and classifier learning into one unified framework for optimal compatibility. A category-guided visual learning module is developed in which a visual classifier is learned based on the feature extractor along with the cosine similarity and contrastive loss optimization. To fully explore prior knowledge of category correlations, a knowledge transfer network is then developed to propagate knowledge information among all categories to learn the semantic-visual mapping, thus inferring a knowledge-based classifier for novel categories from base categories. Finally, we design an adaptive fusion scheme to infer the desired classifiers by effectively integrating the above knowledge and visual information. Extensive experiments are conducted on two widely used Mini-ImageNet and Tiered-ImageNet benchmarks to validate the effectiveness of KSTNet. Compared with the state of the art, the results show that the proposed method achieves favorable performance with minimal bells and whistles, especially in the case of one-shot learning.

RGB-NIR Image Categorization with Prior Knowledge Transfer

Multi-modal Scene Categorization Using Multi-Tasks Learning

Multi-Spectral RGB-NIR Image Classification Using Double-Channel CNN

Multi-domain few-shot image recognition with knowledge transfer

From RGB-D Images to RGB Images

Knowledge-Guided Semantic Transfer Network for Few-Shot Image Recognition

Multispectral Scene Classification via Cross-Modal Knowledge Distillation

Knowledge Driven Weights Estimation for Large-scale Few-shot Image Recognition

Coupled Knowledge Transfer for Visual Data Recognition

Deep Near Infrared Colorization with Semantic Segmentation and Transfer Learning.

Multiclass Classification of Remote Sensing Images Using Deep Learning Techniques

Towards Cross-Category Knowledge Propagation for Learning Visual Concepts

Deep Image Category Discovery Using a Transferred Similarity Function

Class-Incremental Learning for Remote Sensing Images Based on Knowledge Distillation

Spatial Knowledge Transfer for Few-Shot Hyperspectral Image Classification Based on Residual Vision Transformers

Attention Bridging Network For Knowledge Transfer

Feature-Based Knowledge Distillation for Infrared Small Target Detection

Rgb-D Object Recognition Using The Knowledge Transferred From Relevant Rgb Images

Prompt Learning with Cross-Modal Feature Alignment for Visual Domain Adaptation.

Knowledge Transfer and Domain Adaptation for Fine-Grained Remote Sensing Image Segmentation

Cross-Modality Bridging and Knowledge Transferring for Image Understanding