Abstract:In this article, we present a conceptually simple but effective framework called knowledge distillation classifier generation network (KDCGN) for zero-shot learning (ZSL), where the learning agent requires recognizing unseen classes that have no visual data for training. Different from the existing generative approaches that synthesize visual features for unseen classifiers' learning, the proposed framework directly generates classifiers for unseen classes conditioned on the corresponding class-level semantics. To ensure the generated classifiers to be discriminative to the visual features, we borrow the knowledge distillation idea to both supervise the classifier generation and distill the knowledge with, respectively, the visual classifiers and soft targets trained from a traditional classification network. Under this framework, we develop two, respectively, strategies, i.e., class augmentation and semantics guidance, to facilitate the supervision process from the perspectives of improving visual classifiers. Specifically, the class augmentation strategy incorporates some additional categories to train the visual classifiers, which regularizes the visual classifier weights to be compact, under supervision of which the generated classifiers will be more discriminative. The semantics-guidance strategy encodes the class semantics into the visual classifiers, which would facilitate the supervision process by minimizing the differences between the generated and the real-visual classifiers. To evaluate the effectiveness of the proposed framework, we have conducted extensive experiments on five datasets in image classification, i.e., AwA1, AwA2, CUB, FLO, and APY. Experimental results show that the proposed approach performs best in the traditional ZSL task and achieves a significant performance improvement on four out of the five datasets in the generalized ZSL task.

Learning Visual-and-semantic Knowledge Embedding for Zero-Shot Image Classification

Joint Learning of Attended Zero-Shot Features and Visual-Semantic Mapping.

Explainable Zero-Shot Learning Via Attentive Graph Convolutional Network And Knowledge Graphs

Zero-shot learning via visual feature enhancement and dual classifier learning for image recognition

Knowledge Distillation Classifier Generation Network for Zero-Shot Learning

OntoZSL: Ontology-enhanced Zero-shot Learning

Zero-Shot Learning Based on Knowledge Sharing

K-ZSL: Resources for Knowledge-driven Zero-shot Learning

Semantic-visual shared knowledge graph for zero-shot learning

Semantic Graph-enhanced Visual Network for Zero-shot Learning.

Graph-Based Visual-Semantic Entanglement Network for Zero-Shot Image Recognition

Semantic guided knowledge graph for large-scale zero-shot learning

Recognizing Unseen Objects via Multimodal Intensive Knowledge Graph Propagation

Semantic Enhanced Knowledge Graph for Large-Scale Zero-Shot Learning

Disentangled Ontology Embedding for Zero-shot Learning

Multi-Label Zero-Shot Learning with Structured Knowledge Graphs

Generative Adversarial Zero-shot Learning via Knowledge Graphs

Zero-Shot Learning via Discriminative Dual Semantic Auto-Encoder

Zero-Knowledge Zero-Shot Learning for Novel Visual Category Discovery

Residual Graph Convolutional Networks for Zero-Shot Learning.