Abstract:In this article, we present a conceptually simple but effective framework called knowledge distillation classifier generation network (KDCGN) for zero-shot learning (ZSL), where the learning agent requires recognizing unseen classes that have no visual data for training. Different from the existing generative approaches that synthesize visual features for unseen classifiers' learning, the proposed framework directly generates classifiers for unseen classes conditioned on the corresponding class-level semantics. To ensure the generated classifiers to be discriminative to the visual features, we borrow the knowledge distillation idea to both supervise the classifier generation and distill the knowledge with, respectively, the visual classifiers and soft targets trained from a traditional classification network. Under this framework, we develop two, respectively, strategies, i.e., class augmentation and semantics guidance, to facilitate the supervision process from the perspectives of improving visual classifiers. Specifically, the class augmentation strategy incorporates some additional categories to train the visual classifiers, which regularizes the visual classifier weights to be compact, under supervision of which the generated classifiers will be more discriminative. The semantics-guidance strategy encodes the class semantics into the visual classifiers, which would facilitate the supervision process by minimizing the differences between the generated and the real-visual classifiers. To evaluate the effectiveness of the proposed framework, we have conducted extensive experiments on five datasets in image classification, i.e., AwA1, AwA2, CUB, FLO, and APY. Experimental results show that the proposed approach performs best in the traditional ZSL task and achieves a significant performance improvement on four out of the five datasets in the generalized ZSL task.

Class knowledge overlay to visual feature learning for zero-shot image classification

GENERATING MANIFOLD-ALIGNED SEMANTIC FEATURE FOR ZERO-SHOT LEARNING

Zero-Shot Learning with Generative Latent Prototype Model.

Knowledge Distillation Classifier Generation Network for Zero-Shot Learning

Visual Data Synthesis Via GAN for Zero-Shot Video Classification

Multi-modal Generative Adversarial Network for Zero-Shot Learning

Generative Adversarial Zero-shot Learning via Knowledge Graphs

Cross Knowledge-based Generative Zero-Shot Learning approach with Taxonomy Regularization

OntoZSL: Ontology-enhanced Zero-shot Learning

Semantics-Guided Intra-Category Knowledge Transfer for Generalized Zero-Shot Learning

Zero-Knowledge Zero-Shot Learning for Novel Visual Category Discovery

Semantic-visual shared knowledge graph for zero-shot learning

Visual feature synthesis with semantic reconstructor for traditional and generalized zero‐shot object classification

SR-GAN: Semantic Rectifying Generative Adversarial Network for Zero-shot Learning

Explainable Zero-Shot Learning Via Attentive Graph Convolutional Network And Knowledge Graphs

Zero-VAE-GAN: Generating Unseen Features for Generalized and Transductive Zero-Shot Learning

Distilling knowledge from multiple foundation models for zero-shot image classification

Zero-shot learning via visual feature enhancement and dual classifier learning for image recognition

Class-specific Synthesized Dictionary Model for Zero-Shot Learning

Learning discriminative and representative feature with cascade GAN for generalized zero-shot learning

From Zero-shot Learning to Conventional Supervised Classification: Unseen Visual Data Synthesis