Abstract:Existing zero-shot learning (ZSL) models typically learn a projection function from a feature space to a semantic embedding space (e.g. attribute space). However, such a projection function is only concerned with predicting the training seen class semantic representation (e.g. attribute prediction) or classification. When applied to test data, which in the context of ZSL contains different (unseen) classes without training data, a ZSL model typically suffers from the project domain shift problem. In this work, we present a novel solution to ZSL based on learning a Semantic AutoEncoder (SAE). Taking the encoder-decoder paradigm, an encoder aims to project a visual feature vector into the semantic space as in the existing ZSL models. However, the decoder exerts an additional constraint, that is, the projection/code must be able to reconstruct the original visual feature. We show that with this additional reconstruction constraint, the learned projection function from the seen classes is able to generalise better to the new unseen classes. Importantly, the encoder and decoder are linear and symmetric which enable us to develop an extremely efficient learning algorithm. Extensive experiments on six benchmark datasets demonstrate that the proposed SAE outperforms significantly the existing ZSL models with the additional benefit of lower computational cost. Furthermore, when the SAE is applied to supervised clustering problem, it also beats the state-of-the-art.

A Semantic Similarity Supervised Autoencoder for Zero-Shot Learning.

Joint Learning of Attended Zero-Shot Features and Visual-Semantic Mapping.

Weakly Supervised Classification Model for Zero‐shot Semantic Segmentation

Semantic Autoencoder for Zero-Shot Learning

A Distance-Constrained Semantic Autoencoder for Zero-Shot Remote Sensing Scene Classification

Semantic Softmax Loss for Zero-Shot Learning

Cross-Layer Autoencoder for Zero-Shot Learning

Transductive Unbiased Embedding for Zero-Shot Learning

Zero Shot Learning Via Low-rank Embedded Semantic AutoEncoder

Zero-Shot Learning via Discriminative Dual Semantic Auto-Encoder

Automatic Metrics Learning with Low‐noise Embedding for Zero‐shot Learning

Generalized Zero-Shot Recognition based on Visually Semantic Embedding

Zero-shot learning via a specific rank-controlled semantic autoencoder

Zero-shot Object Detection with Contrastive Semantic Association Network

A Simple Discriminative Dual Semantic Auto-encoder for Zero-shot Classification.

Self-Supervised Approach to Addressing Zero-Shot Learning Problem

Bi-Adversarial Auto-Encoder for Zero-Shot Learning

Zero-Shot Learning for Semantic Utterance Classification

Zero-Shot Visual Recognition Using Semantics-Preserving Adversarial Embedding Networks

Zero-Shot Learning on Semantic Class Prototype Graph

Global Semantic Consistency for Zero-Shot Learning.