Abstract:Zero-shot learning (ZSL) can be formulated as a cross-domain matching problem: after being projected into a joint embedding space, a visual sample will match against all candidate class-level semantic descriptions and be assigned to the nearest class. In this process, the embedding space underpins the success of such matching and is crucial for ZSL. In this paper, we conduct an in-depth study on the construction of embedding space for ZSL and posit that an ideal embedding space should satisfy two criteria: intra-class compactness and inter-class separability. While the former encourages the embeddings of visual samples of one class to distribute tightly close to the semantic description embedding of this class, the latter requires embeddings from different classes to be well separated from each other. Towards this goal, we present a simple but effective two-branch network to simultaneously map semantic descriptions and visual samples into a joint space, on which visual embeddings are forced to regress to their class-level semantic embeddings and the embeddings crossing classes are required to be distinguishable by a trainable classifier. Furthermore, we extend our method to a transductive setting to better handle the model bias problem in ZSL (i.e., samples from unseen classes tend to be categorized into seen classes) with minimal extra supervision. Specifically, we propose a pseudo labeling strategy to progressively incorporate the testing samples into the training process and thus balance the model between seen and unseen classes. Experimental results on five standard ZSL datasets show the superior performance of the proposed method and its transductive extension.

Region interaction and attribute embedding for zero-shot learning

Joint Learning of Attended Zero-Shot Features and Visual-Semantic Mapping.

Region Graph Embedding Network for Zero-Shot Learning

Zero-Shot Embedding via Regularization-Based Recollection and Residual Familiarity Processes

Region Semantically Aligned Network for Zero-Shot Learning

Learning complementary semantic information for zero-shot recognition

Visual-guided attentive attributes embedding for zero-shot learning

Transductive Unbiased Embedding for Zero-Shot Learning

Towards Zero-Shot Learning: A Brief Review and an Attention-Based Embedding Network

Meta-Transfer Networks for Zero-Shot Learning

Learning discriminative visual semantic embedding for zero-shot recognition

Zero-Shot Learning With Attentive Region Embedding and Enhanced Semantics

Zero-Shot Leaning With Manifold Embedding

Group-wise interactive region learning for zero-shot recognition

Manifold Regularized Cross-Modal Embedding for Zero-Shot Learning

Manifold Embedding for Zero-Shot Recognition

Zero Shot Learning Via Low-rank Embedded Semantic AutoEncoder

Attribute self-representation steered by exclusive lasso for zero-shot learning

Zero-Shot Learning via Category-Specific Visual-Semantic Mapping and Label Refinement

High-Discriminative Attribute Feature Learning for Generalized Zero-Shot Learning

Towards Effective Deep Embedding for Zero-Shot Learning