Abstract:Zero-shot learning aims at recognizing unseen classes (no training example) with knowledge transferred from seen classes. This is typically achieved by exploiting a semantic feature space shared by both seen and unseen classes, i.e., attribute or word vector, as the bridge. One common practice in zero-shot learning is to train a projection between the visual and semantic feature spaces with labeled seen classes examples. When inferring, this learned projection is applied to unseen classes and recognizes the class labels by some metrics. However, the visual and semantic feature spaces are mutually independent and have quite different manifold structures. Under such a paradigm, most existing methods easily suffer from the domain shift problem and weaken the performance of zero-shot recognition. To address this issue, we propose a novel model called AMS-SFE. It considers the alignment of manifold structures by semantic feature expansion. Specifically, we build upon an autoencoder-based model to expand the semantic features from the visual inputs. Additionally, the expansion is jointly guided by an embedded manifold extracted from the visual feature space of the data. Our model is the first attempt to align both feature spaces by expanding semantic features and derives two benefits: first, we expand some auxiliary features that enhance the semantic feature space; second and more importantly, we implicitly align the manifold structures between the visual and semantic feature spaces; thus, the projection can be better trained and mitigate the domain shift problem. Extensive experiments show significant performance improvement, which verifies the effectiveness of our model.

Generalized Zero-Shot Learning Based on Manifold Alignment

GENERATING MANIFOLD-ALIGNED SEMANTIC FEATURE FOR ZERO-SHOT LEARNING

Learning Visually Aligned Semantic Graph for Cross-Modal Manifold Matching.

Joint Learning of Attended Zero-Shot Features and Visual-Semantic Mapping.

Zero-Shot Learning with Generative Latent Prototype Model.

Zero-Shot Leaning With Manifold Embedding

Manifold Regularized Cross-Modal Embedding for Zero-Shot Learning

Manifold Embedding for Zero-Shot Recognition

An Inverse Mapping With Manifold Alignment For Zero-Shot Learning

Matrix Tri-Factorization With Manifold Regularizations For Zero-Shot Learning

Cluster-based Contrastive Disentangling for Generalized Zero-Shot Learning

Generalized Zero-Shot Learning Via Multi-Modal Aggregated Posterior Aligning Neural Network

A Novel Perspective to Zero-shot Learning: Towards an Alignment of Manifold Structures via Semantic Feature Expansion

Semantic Manifold Alignment in Visual Feature Space for Zero-Shot Learning

Learning Discriminative Latent Features for Generalized Zero-and Few-Shot Learning.

Zero-Shot Learning Via Robust Latent Representation and Manifold Regularization

Zero-Shot Learning Using Stacked Autoencoder With Manifold Regularizations

Indirect visual–semantic alignment for generalized zero-shot recognition

Generalized Zero-Shot Recognition based on Visually Semantic Embedding

Zero-VAE-GAN: Generating Unseen Features for Generalized and Transductive Zero-Shot Learning

Learning MLatent Representations for Generalized Zero-Shot Learning