Abstract:Zero-shot learning (ZSL) trains classifiers on seen classes and utilizes class-level semantic attributes to recognize unseen classes. In recent years, feature generation methods have been employed to address the data imbalance issue in ZSL by synthesizing samples of unseen classes. Nevertheless, the current generation methods solely rely on training the generator using seen classes, resulting in synthesized visual features that are inevitably biased toward seen classes and lack discriminative information. In this paper, we propose an effective ZSL method, termed zero-shot learning via categorization-relevant disentanglement and discriminative samples synthesis. To mitigate the category bias problem, we incorporate a domain discriminator and a semantic decoder into the generative network. By maximizing the decision boundary between categories, distinguishing unseen classes and promoting the alignment of synthetic features with their corresponding semantic embeddings, to enhance semantic consistency. In addition, to reduce the interference of redundant information in visual features, we propose a batch recombining-based disentangling method. The original visual features are projected into categorization-irrelevant and categorization-relevant representations through a conditional encoder, and a correlation penalty is employed to ensure the independence between the two component representations. The categorization-irrelevant representation is reorganized and spliced with the categorization-relevant representation, and disentanglement is achieved by calculating the difference between the post-reorganized and pre-reorganized representations. Finally, we train a classifier using the categorization-relevant representations to improve classification accuracy. Experiments are conducted on four publicly available ZSL datasets, and the proposed method achieves superior results, demonstrating its effectiveness in addressing the challenges of ZSL.

Learning Internal Semantics with Expanded Categories for Generative Zero-Shot Learning

Zero-Shot Learning with Generative Latent Prototype Model.

GENERATING MANIFOLD-ALIGNED SEMANTIC FEATURE FOR ZERO-SHOT LEARNING

Joint Learning of Attended Zero-Shot Features and Visual-Semantic Mapping.

Multi-modal Generative Adversarial Network for Zero-Shot Learning

OntoZSL: Ontology-enhanced Zero-shot Learning

Visual-Semantic Aligned Bidirectional Network for Zero-Shot Learning

Semantics-Guided Intra-Category Knowledge Transfer for Generalized Zero-Shot Learning

Investigating the Bilateral Connections in Generative Zero-Shot Learning

Semantic Enhanced Cross-modal GAN for Zero-shot Learning

Zero-Shot Learning with Joint Generative Adversarial Networks

Visual-Augmented Dynamic Semantic Prototype for Generative Zero-Shot Learning

Zero-Shot Learning via Category-Specific Visual-Semantic Mapping and Label Refinement

Zero-VAE-GAN: Generating Unseen Features for Generalized and Transductive Zero-Shot Learning

Zero-shot Learning Via Categorization-Relevant Disentanglement and Discriminative Samples Synthesis

A Joint Generative Model For Zero-Shot Learning

Improving Generalized Zero-Shot Learning by Exploring the Diverse Semantics from External Class Names

Semantic Compression Embedding for Generative Zero-Shot Learning

Continual Zero-Shot Learning through Semantically Guided Generative Random Walks

RE-GZSL: Relation Extrapolation for Generalized Zero-Shot Learning