Abstract:Generalized zero-shot learning (GZSL) aims to simultaneously recognize both seen classes and unseen classes by training only on seen class samples and auxiliary semantic descriptions. Recent state-of-the-art methods infer unseen classes based on semantic information or synthesize unseen classes using generative models based on semantic information, all of which rely on the correct alignment of visual–semantic features. However, they often overlook the inconsistency between original visual features and semantic attributes. Additionally, due to the existence of cross-modal dataset biases, the visual features extracted and synthesized by the model may also mismatch with some semantic features, which could hinder the model from properly aligning visual–semantic features. To address this issue, this paper proposes a GZSL framework that enhances the consistency of visual–semantic features using a self-distillation and disentanglement network (SDDN). The aim is to utilize the self-distillation and disentanglement network to obtain semantically consistent refined visual features and non-redundant semantic features to enhance the consistency of visual–semantic features. Firstly, SDDN utilizes self-distillation technology to refine the extracted and synthesized visual features of the model. Subsequently, the visual–semantic features are then disentangled and aligned using a disentanglement network to enhance the consistency of the visual–semantic features. Finally, the consistent visual–semantic features are fused to jointly train a GZSL classifier. Extensive experiments demonstrate that the proposed method achieves more competitive results on four challenging benchmark datasets (AWA2, CUB, FLO, and SUN).

Improving Generalized Zero-Shot Learning by Exploring the Diverse Semantics from External Class Names

GENERATING MANIFOLD-ALIGNED SEMANTIC FEATURE FOR ZERO-SHOT LEARNING

Cluster-based Contrastive Disentangling for Generalized Zero-Shot Learning

Semantics Disentangling for Generalized Zero-Shot Learning

Learn More from Less: Generalized Zero-Shot Learning with Severely Limited Labeled Data

Improving generalized zero-shot learning via cluster-based semantic disentangling representation

OntoZSL: Ontology-enhanced Zero-shot Learning

Simple Is Better: A Global Semantic Consistency Based End-To-End Framework For Effective Zero-Shot Learning

SEER-ZSL: Semantic Encoder-Enhanced Representations for Generalized Zero-Shot Learning

Leveraging Self-Distillation and Disentanglement Network to Enhance Visual–Semantic Feature Consistency in Generalized Zero-Shot Learning

Less but Better: Enabling Generalized Zero-shot Learning Towards Unseen Domains by Intrinsic Learning from Redundant LLM Semantics

Multi-modal Generative Adversarial Network for Zero-Shot Learning

Disentangled Ontology Embedding for Zero-shot Learning

Dual Adversarial Semantics-Consistent Network for Generalized Zero-Shot Learning

Global Semantic Consistency for Zero-Shot Learning.

Semantic-diversity transfer network for generalized zero-shot learning via inner disagreement based OOD detector

Better Transferability with Attribute Attention for Generalized Zero-Shot Learning

Meta-Transfer Networks for Zero-Shot Learning

Unbiased Hybrid Generation Network for Zero-Shot Learning

Learning Multiple Criteria Calibration for Generalized Zero-shot Learning

Semantic-Related Feature Generation for Generalized Zero-Shot Learning