Abstract:Zero-shot learning (ZSL) tackles the unseen class recognition problem by transferring semantic knowledge from seen classes to unseen ones. Typically, to guarantee desirable knowledge transfer, a direct embedding is adopted for associating the visual and semantic domains in ZSL. However, most existing ZSL methods focus on learning the embedding from implicit global features or image regions to the semantic space. Thus, they fail to: 1) exploit the appearance relationship priors between various local regions in a single image, which corresponds to the semantic information and 2) learn cooperative global and local features jointly for discriminative feature representations. In this article, we propose the novel graph navigated dual attention network (GNDAN) for ZSL to address these drawbacks. GNDAN employs a region-guided attention network (RAN) and a region-guided graph attention network (RGAT) to jointly learn a discriminative local embedding and incorporate global context for exploiting explicit global embeddings under the guidance of a graph. Specifically, RAN uses soft spatial attention to discover discriminative regions for generating local embeddings. Meanwhile, RGAT employs an attribute-based attention to obtain attribute-based region features, where each attribute focuses on the most relevant image regions. Motivated by the graph neural network (GNN), which is beneficial for structural relationship representations, RGAT further leverages a graph attention network to exploit the relationships between the attribute-based region features for explicit global embedding representations. Based on the self-calibration mechanism, the joint visual embedding learned is matched with the semantic embedding to form the final prediction. Extensive experiments on three benchmark datasets demonstrate that the proposed GNDAN achieves superior performances to the state-of-the-art methods. Our code and trained models are available at https://github.com/shiming-chen/GNDAN.

Discrepancy-Aware Attention Network for Enhanced Audio-Visual Zero-Shot Learning

Attentive Semantic Preservation Network for Zero-Shot Learning.

Object-Aware Image Augmentation for Audio-Visual Zero-Shot Learning

Multi-scale Visual Attention for Attribute Disambiguation in Zero-Shot Learning

Audio-visual Generalised Zero-shot Learning with Cross-modal Attention and Language

Contrast and Aggregation Network for Generalized Zero-shot Learning

Adaptive Conditional Denoising Diffusion Model with Hybrid Affinity Regularizer for Generalized Zero-shot Learning

Zero-Shot Learning via Discriminative Dual Semantic Auto-Encoder

Audio-visual Generalized Zero-shot Learning the Easy Way

Incorporating Attribute-Level Aligned Comparative Network for Generalized Zero-Shot Learning

HSVA: Hierarchical Semantic-Visual Adaptation for Zero-Shot Learning

Special Modality independent adversarial network for generalized zero shot image classification

Generalized Zero-Shot Learning Via Multi-Modal Aggregated Posterior Aligning Neural Network

GNDAN: Graph Navigated Dual Attention Network for Zero-Shot Learning.

Generation-based Contrastive Model with Semantic Alignment for Generalized Zero-Shot Learning

Modality-Fusion Spiking Transformer Network for Audio-Visual Zero-Shot Learning

Attend and Enrich: Enhanced Visual Prompt for Zero-Shot Learning

Modality independent adversarial network for generalized zero shot image classification

Zero-Shot Visual Recognition Using Semantics-Preserving Adversarial Embedding Networks

Discriminative and Robust Attribute Alignment for Zero-Shot Learning

A Discriminative Cross-Aligned Variational Autoencoder for Zero-Shot Learning