Abstract:Zero-shot learning (ZSL) can be formulated as a cross-domain matching problem: after being projected into a joint embedding space, a visual sample will match against all candidate class-level semantic descriptions and be assigned to the nearest class. In this process, the embedding space underpins the success of such matching and is crucial for ZSL. In this paper, we conduct an in-depth study on the construction of embedding space for ZSL and posit that an ideal embedding space should satisfy two criteria: intra-class compactness and inter-class separability. While the former encourages the embeddings of visual samples of one class to distribute tightly close to the semantic description embedding of this class, the latter requires embeddings from different classes to be well separated from each other. Towards this goal, we present a simple but effective two-branch network to simultaneously map semantic descriptions and visual samples into a joint space, on which visual embeddings are forced to regress to their class-level semantic embeddings and the embeddings crossing classes are required to be distinguishable by a trainable classifier. Furthermore, we extend our method to a transductive setting to better handle the model bias problem in ZSL (i.e., samples from unseen classes tend to be categorized into seen classes) with minimal extra supervision. Specifically, we propose a pseudo labeling strategy to progressively incorporate the testing samples into the training process and thus balance the model between seen and unseen classes. Experimental results on five standard ZSL datasets show the superior performance of the proposed method and its transductive extension.

Fine-Grained Zero-Shot Learning: Advances, Challenges, and Prospects

OntoZSL: Ontology-enhanced Zero-shot Learning

Knowledge-aware Zero-Shot Learning: Survey and Perspective

Meta-Transfer Networks for Zero-Shot Learning

A Review of Generalized Zero-Shot Learning Methods

Learn More from Less: Generalized Zero-Shot Learning with Severely Limited Labeled Data

Transductive Unbiased Embedding for Zero-Shot Learning

Disentangled Ontology Embedding for Zero-shot Learning

Multi-modal Generative Adversarial Network for Zero-Shot Learning

Stacked Semantic-Guided Attention Model for Fine-Grained Zero-Shot Learning.

A review on multimodal zero‐shot learning

Towards Zero-Shot Learning: A Brief Review and an Attention-Based Embedding Network

Incremental Zero-Shot Learning

A Survey of Zero Shot Detection: Methods and Applications

Recent Advances in Zero-shot Recognition

Zero-Knowledge Zero-Shot Learning for Novel Visual Category Discovery

Learning discriminative visual semantic embedding for zero-shot recognition

Towards Effective Deep Embedding for Zero-Shot Learning

Holistically Associated Transductive Zero-Shot Learning

Zero-Shot Learning via Category-Specific Visual-Semantic Mapping and Label Refinement

Dynamic visual-guided selection for zero-shot learning