Abstract:<p>Zero Shot Learning (ZSL) aims to classify images of unseen target classes by transferring knowledge from source classes through semantic embeddings. The core of ZSL research is to embed both visual representation of object instance and semantic description of object class into a joint latent space and learn cross-modal (visual and semantic) latent representations. However, the learned representations by existing efforts often fail to fully capture the underlying cross-modal semantic consistency, and some of the representations are very similar and less discriminative. To circumvent these issues, in this paper, we propose a novel deep framework, called Modality Independent Adversarial Network (MIANet) for Generalized Zero Shot Learning (GZSL), which is an end-to-end deep architecture with three submodules. First, both visual feature and semantic description are embedded into a latent hyper-spherical space, where two orthogonal constraints are employed to ensure the learned latent representations discriminative. Second, a modality adversarial submodule is employed to make the latent representations independent of modalities to make the shared representations grab more cross-modal high-level semantic information during training. Third, a cross reconstruction submodule is proposed to reconstruct latent representations into the counterparts instead of themselves to make them capture more modality irrelevant information. Comprehensive experiments on five widely used benchmark datasets are conducted on both GZSL and standard ZSL settings, and the results show the effectiveness of our proposed method.</p>

Cross-modal propagation network for generalized zero-shot learning

GENERATING MANIFOLD-ALIGNED SEMANTIC FEATURE FOR ZERO-SHOT LEARNING

Zero-Shot Learning with Generative Latent Prototype Model.

Multi-modal Generative Adversarial Network for Zero-Shot Learning

Manifold Regularized Cross-Modal Embedding for Zero-Shot Learning

Unbiased Hybrid Generation Network for Zero-Shot Learning

Modality independent adversarial network for generalized zero shot image classification

OntoZSL: Ontology-enhanced Zero-shot Learning

Isometric Propagation Network for Generalized Zero-shot Learning

Meta-Transfer Networks for Zero-Shot Learning

Zero-Shot Learning with Joint Generative Adversarial Networks

Residual-Prototype Generating Network for Generalized Zero-Shot Learning

Learn More from Less: Generalized Zero-Shot Learning with Severely Limited Labeled Data

Prototype-Augmented Self-Supervised Generative Network for Generalized Zero-Shot Learning.

Cross Knowledge-based Generative Zero-Shot Learning approach with Taxonomy Regularization

Generalized Zero-Shot Learning With Multiple Graph Adaptive Generative Networks

Explainable Zero-Shot Learning Via Attentive Graph Convolutional Network And Knowledge Graphs

Multi-label zero-shot learning with graph convolutional networks

Visual-Semantic Aligned Bidirectional Network for Zero-Shot Learning

Learning Multiple Criteria Calibration for Generalized Zero-shot Learning

Learning discriminative and representative feature with cascade GAN for generalized zero-shot learning