Abstract:Generalized Zero-Shot Learning (GZSL) learns from only labeled seen classes during training but discriminates both seen and unseen classes during testing. In GZSL tasks, most of the existing methods commonly utilize visual and semantic features for training. Due to the lack of visual features for unseen classes, recent works generate real-like visual features by using semantic features. However, the synthesized features in the original feature space lack discriminative information. It is important that the synthesized visual features should be similar to the ones in the same class, but different from the other classes. One way to solve this problem is to introduce the embedding space after generating visual features. Following this situation, the embedded features from the embedding space can be inconsistent with the original semantic features. For another way, some recent methods constrain the representation by reconstructing the semantic features using the original visual features and the synthesized visual features. In this paper, we propose a hybrid GZSL model, named feature Contrastive optimization for GZSL (Co-GZSL), to reconstruct the semantic features from the embedded features, which ensures that the embedded features are close to the original semantic features indirectly by comparing reconstructed semantic features with original semantic features. In addition, to settle the problem that the synthesized features lack discrimination and semantic consistency, we introduce a Feature Contrastive Optimization Module (FCOM) and jointly utilize contrastive and semantic cycle-consistency losses in the FCOM to strengthen the intra-class compactness and the inter-class separability and to encourage the model to generate semantically consistent and discriminative visual features. By combining the generative module, the embedding module, and the FCOM, we achieve Co-GZSL. We evaluate the proposed Co-GZSL model on four benchmarks, and the experimental results indicate that our model is superior over current methods. Code is available at: https://github.com/zhanzhuxi/Co-GZSL.

RE-GZSL: Relation Extrapolation for Generalized Zero-Shot Learning

Cluster-based Contrastive Disentangling for Generalized Zero-Shot Learning

GENERATING MANIFOLD-ALIGNED SEMANTIC FEATURE FOR ZERO-SHOT LEARNING

Contrastive Visual Feature Filtering for Generalized Zero-Shot Learning

Semantics Disentangling for Generalized Zero-Shot Learning

Semantic-Related Feature Generation for Generalized Zero-Shot Learning

OntoZSL: Ontology-enhanced Zero-shot Learning

Improving generalized zero-shot learning via cluster-based semantic disentangling representation

SEER-ZSL: Semantic Encoder-Enhanced Representations for Generalized Zero-Shot Learning

Residual-Prototype Generating Network for Generalized Zero-Shot Learning

Co-GZSL: Feature Contrastive Optimization for Generalized Zero-Shot Learning

Improving Generalized Zero-Shot Learning by Exploring the Diverse Semantics from External Class Names

Leveraging Self-Distillation and Disentanglement Network to Enhance Visual–Semantic Feature Consistency in Generalized Zero-Shot Learning

On the Transferability of Visual Features in Generalized Zero-Shot Learning

Visual feature synthesis with semantic reconstructor for traditional and generalized zero‐shot object classification

Generative-based hybrid model with semantic representations for generalized zero-shot learning

Self-supervised learning of pseudo classes for generalized zero-shot fine-grained recognition

Towards Discriminative Feature Generation for Generalized Zero-Shot Learning

Logic-guided Semantic Representation Learning for Zero-Shot Relation Classification.

FREE: Feature Refinement for Generalized Zero-Shot Learning

Generalized Zero-Shot Image Classification via Partially-Shared Multi-Task Representation Learning