Abstract:Generalized Zero-Shot Learning (GZSL) holds significant research importance as it enables the classification of samples from both seen and unseen classes. A prevailing approach for GZSL is learning transferable representations that can generalize well to both seen and unseen classes during testing. This approach encompasses two key concepts: discriminative representations and semantic-relevant representations. "Semantic-relevant" facilitates the transfer of semantic knowledge using pre-defined semantic descriptors, while "discriminative" is crucial for accurate category discrimination. However, these two concepts are arguably inherently conflicting, as semantic descriptors are not specifically designed for image classification. Existing methods often struggle with balancing these two aspects and neglect the conflict between them, leading to suboptimal representation generalization and transferability to unseen classes. To address this issue, we propose a novel partially-shared multi-task representation learning method, termed PS-GZSL, which jointly preserves complementary and sharable knowledge between these two concepts. Specifically, we first propose a novel perspective that treats the learning of discriminative and semantic-relevant representations as optimizing a discrimination task and a visual-semantic alignment task, respectively. Then, to learn more complete and generalizable representations, PS-GZSL explicitly factorizes visual features into task-shared and task-specific representations and introduces two advanced tasks: an instance-level contrastive discrimination task and a relation-based visual-semantic alignment task. Furthermore, PS-GZSL employs Mixture-of-Experts (MoE) with a dropout mechanism to prevent representation degeneration and integrates a conditional GAN (cGAN) to synthesize unseen features for estimating unseen visual features. Extensive experiments and more competitive results on five widely-used GZSL benchmark datasets validate the effectiveness of our PS-GZSL.

A Robust Generalized Zero-Shot Learning Method with Attribute Prototype and Discriminative Attention Mechanism

Zero-Shot Learning with Generative Latent Prototype Model.

GENERATING MANIFOLD-ALIGNED SEMANTIC FEATURE FOR ZERO-SHOT LEARNING

Better Transferability with Attribute Attention for Generalized Zero-Shot Learning

Cluster-based Contrastive Disentangling for Generalized Zero-Shot Learning

Prototype-Augmented Self-Supervised Generative Network for Generalized Zero-Shot Learning.

Visual-guided attentive attributes embedding for zero-shot learning

`Eyes of a Hawk and Ears of a Fox': Part Prototype Network for Generalized Zero-Shot Learning

Multi-modal Generative Adversarial Network for Zero-Shot Learning

Dual Feature Augmentation Network for Generalized Zero-shot Learning

Boosting Zero-shot Learning via Contrastive Optimization of Attribute Representations

Visual and Semantic Prototypes-Jointly Guided CNN for Generalized Zero-shot Learning

Modality independent adversarial network for generalized zero shot image classification

Dual Progressive Prototype Network for Generalized Zero-Shot Learning

High-Discriminative Attribute Feature Learning for Generalized Zero-Shot Learning

Simple Is Better: A Global Semantic Consistency Based End-To-End Framework For Effective Zero-Shot Learning

Generalized Zero-Shot Image Classification via Partially-Shared Multi-Task Representation Learning

Towards Zero-Shot Learning: A Brief Review and an Attention-Based Embedding Network

Improving Generalized Zero-Shot Learning by Exploring the Diverse Semantics from External Class Names

Zero-shot learning via visual feature enhancement and dual classifier learning for image recognition

Residual-Prototype Generating Network for Generalized Zero-Shot Learning