Abstract:In this article, we present a conceptually simple but effective framework called knowledge distillation classifier generation network (KDCGN) for zero-shot learning (ZSL), where the learning agent requires recognizing unseen classes that have no visual data for training. Different from the existing generative approaches that synthesize visual features for unseen classifiers' learning, the proposed framework directly generates classifiers for unseen classes conditioned on the corresponding class-level semantics. To ensure the generated classifiers to be discriminative to the visual features, we borrow the knowledge distillation idea to both supervise the classifier generation and distill the knowledge with, respectively, the visual classifiers and soft targets trained from a traditional classification network. Under this framework, we develop two, respectively, strategies, i.e., class augmentation and semantics guidance, to facilitate the supervision process from the perspectives of improving visual classifiers. Specifically, the class augmentation strategy incorporates some additional categories to train the visual classifiers, which regularizes the visual classifier weights to be compact, under supervision of which the generated classifiers will be more discriminative. The semantics-guidance strategy encodes the class semantics into the visual classifiers, which would facilitate the supervision process by minimizing the differences between the generated and the real-visual classifiers. To evaluate the effectiveness of the proposed framework, we have conducted extensive experiments on five datasets in image classification, i.e., AwA1, AwA2, CUB, FLO, and APY. Experimental results show that the proposed approach performs best in the traditional ZSL task and achieves a significant performance improvement on four out of the five datasets in the generalized ZSL task.

Class-specific Synthesized Dictionary Model for Zero-Shot Learning

Zero-Shot Learning with Generative Latent Prototype Model.

Joint Learning of Attended Zero-Shot Features and Visual-Semantic Mapping.

Synthesizing Samples for Zero-shot Learning

Transductive discriminative dictionary learning approach for zero-shot classification

Classifier and Exemplar Synthesis for Zero-Shot Learning

Elephant Panda Lion Dolphin Dog Monkey ... ... Classes Elephant Dolphin Lion Classifier Training Data Synthesizing Prediction

Meta-Transfer Networks for Zero-Shot Learning

Transductive Zero-Shot Learning with a Self-Training Dictionary Approach

Multi-modal Generative Adversarial Network for Zero-Shot Learning

OntoZSL: Ontology-enhanced Zero-shot Learning

Transductive Unbiased Embedding for Zero-Shot Learning

Zero-Shot Learning via Discriminative Dual Semantic Auto-Encoder

Learn More from Less: Generalized Zero-Shot Learning with Severely Limited Labeled Data

From Zero-shot Learning to Conventional Supervised Classification: Unseen Visual Data Synthesis

Unbiased Hybrid Generation Network for Zero-Shot Learning

Learning Discriminative Latent Attributes for Zero-Shot Classification.

Multi-Label Zero-Shot Learning with Structured Knowledge Graphs

Transformer-Based Approach Via Contrastive Learning for Zero-Shot Detection.

Learning discriminative visual semantic embedding for zero-shot recognition

Knowledge Distillation Classifier Generation Network for Zero-Shot Learning