Abstract:Zero-shot learning aims to classify the visual instances from unseen classes in the absence of training examples. This is typically achieved by directly mapping visual features to a semantic embedding space of classes (e.g., attributes or word vectors), where the similarity between the two modalities can be readily measured. However, the semantic space may not be reliable for recognition due to the noisy class embeddings or visual bias problem. In this paper, we propose a novel binary embedding-based zero-shot learning (BZSL) method, which recognizes the visual instances from unseen classes through an intermediate discriminative Hamming space. Specifically, BZSL jointly learns two binary coding functions to encode both visual instances and class embeddings into the Hamming space, which well alleviates the visual-semantic bias problem. As a desiring property, classifying an unseen instance thereby can be efficiently done by retrieving its nearest class codes with minimal Hamming distance. During training, by introducing two auxiliary variables for the coding functions, we formulate an equivalent correlation maximization problem, which admits an analytical solution. The resulting algorithm thus enjoys both highly efficient training and scalable novel class inferring. Extensive experiments on four benchmark datasets, including the full ImageNet Fall 2011 dataset with over 20k unseen classes, demonstrate the superiority of our method on the zero-shot learning task. Particularly, we show that increasing the binary embedding dimension can inevitably improve the recognition accuracy.

Zero-Shot Recognition Based on Semantic Embeddings and Deep Clustering

Weakly Supervised Classification Model for Zero‐shot Semantic Segmentation

Generalized Zero-Shot Recognition based on Visually Semantic Embedding

Semantic Graph for Zero-Shot Learning.

Zero-Shot Recognition Using Dual Visual-Semantic Mapping Paths.

Zero-Shot Object Recognition By Semantic Manifold Distance

Manifold Embedding for Zero-Shot Recognition

Zero-Knowledge Zero-Shot Learning for Novel Visual Category Discovery

VGSE: Visually-Grounded Semantic Embeddings for Zero-Shot Learning

Zero-Shot Learning on Semantic Class Prototype Graph

Zero-shot image classification via Visual–Semantic Feature Decoupling

Zero-Shot Scene Classification for High Spatial Resolution Remote Sensing Images

Learning Latent Semantic Attributes for Zero-Shot Object Detection.

Adaptive Adjustment with Semantic Embedding for Zero-Shot Object Detection

Recent Advances in Zero-shot Recognition

Zero-Shot Image Tagging By Hierarchical Semantic Embedding

Zero-shot fine-grained classification by deep feature learning with semantics

Semantically Guided Projection for Zero-Shot 3D Model Classification and Retrieval

Zero-Shot Classification by Transferring Knowledge and Preserving Data Structure

See More and Know More: Zero-shot Point Cloud Segmentation via Multi-modal Visual Data

Scalable Zero-Shot Learning Via Binary Visual-Semantic Embeddings