Abstract:Generalized Zero-Shot Learning (GZSL) aims to recognize both seen and unseen categories by establishing visual and semantic relations. Recently, generation-based methods that focus on synthesizing fictitious visual features from corresponding attributes have gained significant attention. However, these generated features often lack discriminative capabilities due to inadequate training of the generative model. To address this issue, we propose a novel Discriminative Enhanced Network (DENet) to harness the potential of the generative model by adapting the training features and imposing constraints on the generated features. Our approach incorporates three pivotal modules: (1) Before the generative network training, we implement a Pre-Tuning Module (PTM) to eliminate irrelevant background noise in the raw features extracted from a fixed CNN backbone. Therefore, PTM can provide tuned training features without redundant noise for generative model. (2) During the generative network training, we propose an Asymmetry Cross-authenticity Contrastive (AC2) loss to group visual features of the same category while repel features from different categories by optimizing a large number of sample pairs. Additionally, we incorporate intra-class and relation-specific inter-class boundaries within the AC2 loss to enrich sample diversity and preserve valid semantic information. (3) Also within the generative network training, a Dual-semantic Alignment Module (DAM) is designed to align visual features with both attributes and label embeddings, enabling the model to learn attribute-related information and discriminative extended semantics. Experiments on four standard benchmarks demonstrate that our approach learns more discriminative features and surpasses the existing methods.

Data Driven Recurrent Generative Adversarial Network for Generalized Zero Shot Image Classification

Zero-Shot Learning with Generative Latent Prototype Model.

GENERATING MANIFOLD-ALIGNED SEMANTIC FEATURE FOR ZERO-SHOT LEARNING

Multi-modal Generative Adversarial Network for Zero-Shot Learning

Cluster-based Contrastive Disentangling for Generalized Zero-Shot Learning

Learning discriminative and representative feature with cascade GAN for generalized zero-shot learning

Generative Adversarial Zero-shot Learning via Knowledge Graphs

SR-GAN: Semantic Rectifying Generative Adversarial Network for Zero-shot Learning

Generalized Zero-Shot Learning With Multiple Graph Adaptive Generative Networks

Zero-VAE-GAN: Generating Unseen Features for Generalized and Transductive Zero-Shot Learning

One-Stage Training Generative Paradigm for Generalized Zero-Shot Learning.

Prototype-Augmented Self-Supervised Generative Network for Generalized Zero-Shot Learning.

Residual-Prototype Generating Network for Generalized Zero-Shot Learning

Visual Data Synthesis Via GAN for Zero-Shot Video Classification

Towards Discriminative Feature Generation for Generalized Zero-Shot Learning

Modality independent adversarial network for generalized zero shot image classification

Zero-Shot Learning with Joint Generative Adversarial Networks

Model Selection for Generalized Zero-shot Learning

Generative-based hybrid model with semantic representations for generalized zero-shot learning

Zero-Shot Learning via Structure-Aligned Generative Adversarial Network

Visual feature synthesis with semantic reconstructor for traditional and generalized zero‐shot object classification