Abstract:In this article, we present a conceptually simple but effective framework called knowledge distillation classifier generation network (KDCGN) for zero-shot learning (ZSL), where the learning agent requires recognizing unseen classes that have no visual data for training. Different from the existing generative approaches that synthesize visual features for unseen classifiers' learning, the proposed framework directly generates classifiers for unseen classes conditioned on the corresponding class-level semantics. To ensure the generated classifiers to be discriminative to the visual features, we borrow the knowledge distillation idea to both supervise the classifier generation and distill the knowledge with, respectively, the visual classifiers and soft targets trained from a traditional classification network. Under this framework, we develop two, respectively, strategies, i.e., class augmentation and semantics guidance, to facilitate the supervision process from the perspectives of improving visual classifiers. Specifically, the class augmentation strategy incorporates some additional categories to train the visual classifiers, which regularizes the visual classifier weights to be compact, under supervision of which the generated classifiers will be more discriminative. The semantics-guidance strategy encodes the class semantics into the visual classifiers, which would facilitate the supervision process by minimizing the differences between the generated and the real-visual classifiers. To evaluate the effectiveness of the proposed framework, we have conducted extensive experiments on five datasets in image classification, i.e., AwA1, AwA2, CUB, FLO, and APY. Experimental results show that the proposed approach performs best in the traditional ZSL task and achieves a significant performance improvement on four out of the five datasets in the generalized ZSL task.

Dual-Uncertainty Guided Cycle-Consistent Network for Zero-Shot Learning

Dual Collaborative Visual-Semantic Mapping for Multi-Label Zero-Shot Image Recognition

Multi-modal Generative Adversarial Network for Zero-Shot Learning

Visual-Semantic Aligned Bidirectional Network for Zero-Shot Learning

Dual Adversarial Semantics-Consistent Network for Generalized Zero-Shot Learning

Dual-aligned Feature Confusion Alleviation for Generalized Zero-shot Learning

Meta-Transfer Networks for Zero-Shot Learning

Zero-shot learning via visual feature enhancement and dual classifier learning for image recognition

Zero-Shot Learning via Discriminative Dual Semantic Auto-Encoder

Information Bottleneck and Selective Noise Supervision for Zero-Shot Learning

Leveraging Self-Distillation and Disentanglement Network to Enhance Visual–Semantic Feature Consistency in Generalized Zero-Shot Learning

Dual Progressive Prototype Network for Generalized Zero-Shot Learning

Global Semantic Consistency for Zero-Shot Learning.

Information Bottleneck Constrained Latent Bidirectional Embedding for Zero-Shot Learning

A Simple Discriminative Dual Semantic Auto-encoder for Zero-shot Classification.

Cooperative Coupled Generative Networks for Generalized Zero-Shot Learning

Knowledge Distillation Classifier Generation Network for Zero-Shot Learning

Simple Is Better: A Global Semantic Consistency Based End-To-End Framework For Effective Zero-Shot Learning

Visual and Semantic Prototypes-Jointly Guided CNN for Generalized Zero-shot Learning

Dual Part Discovery Network for Zero-Shot Learning

Semantic Graph-enhanced Visual Network for Zero-shot Learning.