Abstract:In this article, we present a conceptually simple but effective framework called knowledge distillation classifier generation network (KDCGN) for zero-shot learning (ZSL), where the learning agent requires recognizing unseen classes that have no visual data for training. Different from the existing generative approaches that synthesize visual features for unseen classifiers' learning, the proposed framework directly generates classifiers for unseen classes conditioned on the corresponding class-level semantics. To ensure the generated classifiers to be discriminative to the visual features, we borrow the knowledge distillation idea to both supervise the classifier generation and distill the knowledge with, respectively, the visual classifiers and soft targets trained from a traditional classification network. Under this framework, we develop two, respectively, strategies, i.e., class augmentation and semantics guidance, to facilitate the supervision process from the perspectives of improving visual classifiers. Specifically, the class augmentation strategy incorporates some additional categories to train the visual classifiers, which regularizes the visual classifier weights to be compact, under supervision of which the generated classifiers will be more discriminative. The semantics-guidance strategy encodes the class semantics into the visual classifiers, which would facilitate the supervision process by minimizing the differences between the generated and the real-visual classifiers. To evaluate the effectiveness of the proposed framework, we have conducted extensive experiments on five datasets in image classification, i.e., AwA1, AwA2, CUB, FLO, and APY. Experimental results show that the proposed approach performs best in the traditional ZSL task and achieves a significant performance improvement on four out of the five datasets in the generalized ZSL task.

Distilling knowledge from multiple foundation models for zero-shot image classification

Zero-Shot Learning with Generative Latent Prototype Model.

Zero-Shot Detection with Transferable Object Proposal Mechanism.

Multi-method Integration with Confidence-based Weighting for Zero-shot Image Classification

OntoZSL: Ontology-enhanced Zero-shot Learning

Recent Advances in Zero-shot Recognition

Image-free Classifier Injection for Zero-Shot Classification

Data-Free Generalized Zero-Shot Learning

Zero-Shot Recognition Based on Semantic Embeddings and Deep Clustering

Transformer-Based Approach Via Contrastive Learning for Zero-Shot Detection.

Learn More from Less: Generalized Zero-Shot Learning with Severely Limited Labeled Data

Zero-Shot Learning with Transferred Samples

Class knowledge overlay to visual feature learning for zero-shot image classification

See More and Know More: Zero-shot Point Cloud Segmentation via Multi-modal Visual Data

Knowledge Distillation Classifier Generation Network for Zero-Shot Learning

Classifier and Exemplar Synthesis for Zero-Shot Learning

Zero-Shot Image Classification Method Based on Attention Mechanism and Semantic Information Fusion

Zero-shot learning via visual feature enhancement and dual classifier learning for image recognition

Online Zero-Shot Classification with CLIP

Synthesizing Samples for Zero-shot Learning

Zero-Knowledge Zero-Shot Learning for Novel Visual Category Discovery