Abstract:Generalized Zero-Shot Learning (GZSL) is the task of leveraging semantic information (e.g., attributes) to recognize the seen and unseen samples, where unseen classes are not observable during training. It is natural to derive generative models and hallucinate training samples for unseen classes based on the knowledge learned from the seen samples. However, most of these models suffer from the `generation shifts', where the synthesized samples may drift from the real distribution of unseen data. In this paper, we conduct an in-depth analysis on this issue and propose a novel Generation Shifts Mitigating Flow (GSMFlow) framework, which is comprised of multiple conditional affine coupling layers for learning unseen data synthesis efficiently and effectively. In particular, we identify three potential problems that trigger the generation shifts, i.e., semantic inconsistency, variance decay, and structural permutation and address them respectively. First, to reinforce the correlations between the generated samples and the respective attributes, we explicitly embed the semantic information into the transformations in each of the coupling layers. Second, to recover the intrinsic variance of the synthesized unseen features, we introduce a visual perturbation strategy to diversify the intra-class variance of generated data and hereby help adjust the decision boundary of the classifier. Third, to avoid structural permutation in the semantic space, we propose a relative positioning strategy to manipulate the attribute embeddings, guiding which to fully preserve the inter-class geometric structure. Experimental results demonstrate that GSMFlow achieves state-of-the-art recognition performance in both conventional and generalized zero-shot settings. Our code is available at: <a class="link-external link-https" href="https://github.com/uqzhichen/GSMFlow" rel="external noopener nofollow">this https URL</a>

Generalized Zero-Shot Learning via VAE-Conditioned Generative Flow

GENERATING MANIFOLD-ALIGNED SEMANTIC FEATURE FOR ZERO-SHOT LEARNING

Zero-Shot Learning with Generative Latent Prototype Model.

GSMFlow: Generation Shifts Mitigating Flow for Generalized Zero-Shot Learning

Zero-VAE-GAN: Generating Unseen Features for Generalized and Transductive Zero-Shot Learning

Mitigating Generation Shifts for Generalized Zero-Shot Learning

A Joint Generative Model For Zero-Shot Learning

Generalized Zero-Shot Learning with Multi-Channel Gaussian Mixture VAE

Visual-Augmented Dynamic Semantic Prototype for Generative Zero-Shot Learning

Generalized Zero-Shot Learning With Multiple Graph Adaptive Generative Networks

Semantics Disentangling for Generalized Zero-Shot Learning

Dual VAEGAN: A generative model for generalized zero-shot learning

Learning discriminative and representative feature with cascade GAN for generalized zero-shot learning

Learn More from Less: Generalized Zero-Shot Learning with Severely Limited Labeled Data

Generalized Zero-Shot Learning Via Multi-Modal Aggregated Posterior Aligning Neural Network

Learning Modality-Consistent Latent Representations for Generalized Zero-Shot Learning

Generative-based hybrid model with semantic representations for generalized zero-shot learning

OntoZSL: Ontology-enhanced Zero-shot Learning

A Discriminative Cross-Aligned Variational Autoencoder for Zero-Shot Learning

Learning MLatent Representations for Generalized Zero-Shot Learning

Continual Zero-Shot Learning through Semantically Guided Generative Random Walks