Abstract:Zero-Shot Learning (ZSL) involves transferring knowledge from seen classes to unseen classes by establishing connections between visual and semantic spaces. Traditional ZSL methods identify novel classes by class-level attribute vectors, which implies an information bottleneck. These approaches often use class-level attribute vectors as the fitting target during training, disregarding the individual variations within a class. Moreover, the attributes used for training lack location information and are prone to mismatch with local regions of visual features. To this end, we introduce a Near-Instance-Level Attribute Bottleneck (IAB) to alter class-level attribute vectors as well as visual features throughout the training phase to better reflect their naturalistic correspondences. Specifically, our Near-Instance-Wise Attribute Adaptation (NAA) modifies class attribute vectors to obtain multiple attribute basis vectors, generating a subspace that is more relevant to instance-level samples. Additionally, our Vision Attribute Relation Strengthening (VARS) module searches for attribute-related regions within the features, offering additional location information during the training phase. The proposed method is evaluated on four ZSL benchmarks, revealing that it is superior or competitive to the state-of-the-art methods on ZSL and the more challenging Generalized Zero-Shot Learning (GZSL) settings. Extensive experiments corroborate the sustainability of this study as one of the most potential directions for ZSL, i.e. , the effectiveness of enhancing the visual-semantic relationships formed during training using a simple model structure. Code is available at: https://github.com/LanchJL/IAB-GZSL.

A plug-in attribute correction module for generalized zero-shot learning

Cluster-based Contrastive Disentangling for Generalized Zero-Shot Learning

A Robust Generalized Zero-Shot Learning Method with Attribute Prototype and Discriminative Attention Mechanism

Estimation of Near-Instance-Level Attribute Bottleneck for Zero-Shot Learning

Feature Fine-Tuning and Attribute Representation Transformation for Zero-Shot Learning.

Zero-Shot Learning via Attribute Regression and Class Prototype Rectification

OntoZSL: Ontology-enhanced Zero-shot Learning

Better Transferability with Attribute Attention for Generalized Zero-Shot Learning

Boosting Zero-shot Learning via Contrastive Optimization of Attribute Representations

Language-Augmented Pixel Embedding for Generalized Zero-Shot Learning

Visual-guided attentive attributes embedding for zero-shot learning

Improving Generalization via Attribute Selection on Out-of-the-box Data

Attribute self-representation steered by exclusive lasso for zero-shot learning

Multi-granularity contrastive zero-shot learning model based on attribute decomposition

Learning complementary semantic information for zero-shot recognition

Learning Discriminative Latent Attributes for Zero-Shot Classification.

Improving Generalized Zero-Shot Learning by Exploring the Diverse Semantics from External Class Names

Zero-shot Learning with a Partial Set of Observed Attributes

Zero-Shot Learning with Attribute Selection.

Complementary Attributes: A New Clue to Zero-Shot Learning

A Joint Label Space For Generalized Zero-Shot Classification