Abstract:Zero-shot learning (ZSL) tackles the unseen class recognition problem by transferring semantic knowledge from seen classes to unseen ones. Typically, to guarantee desirable knowledge transfer, a direct embedding is adopted for associating the visual and semantic domains in ZSL. However, most existing ZSL methods focus on learning the embedding from implicit global features or image regions to the semantic space. Thus, they fail to: 1) exploit the appearance relationship priors between various local regions in a single image, which corresponds to the semantic information and 2) learn cooperative global and local features jointly for discriminative feature representations. In this article, we propose the novel graph navigated dual attention network (GNDAN) for ZSL to address these drawbacks. GNDAN employs a region-guided attention network (RAN) and a region-guided graph attention network (RGAT) to jointly learn a discriminative local embedding and incorporate global context for exploiting explicit global embeddings under the guidance of a graph. Specifically, RAN uses soft spatial attention to discover discriminative regions for generating local embeddings. Meanwhile, RGAT employs an attribute-based attention to obtain attribute-based region features, where each attribute focuses on the most relevant image regions. Motivated by the graph neural network (GNN), which is beneficial for structural relationship representations, RGAT further leverages a graph attention network to exploit the relationships between the attribute-based region features for explicit global embedding representations. Based on the self-calibration mechanism, the joint visual embedding learned is matched with the semantic embedding to form the final prediction. Extensive experiments on three benchmark datasets demonstrate that the proposed GNDAN achieves superior performances to the state-of-the-art methods. Our code and trained models are available at https://github.com/shiming-chen/GNDAN.

Dual-focus transfer network for zero-shot learning

Joint Learning of Attended Zero-Shot Features and Visual-Semantic Mapping.

Contrastive Visual Feature Filtering for Generalized Zero-Shot Learning

Dual Feature Augmentation Network for Generalized Zero-shot Learning

Transformer-Based Approach Via Contrastive Learning for Zero-Shot Detection.

Multi-modal Generative Adversarial Network for Zero-Shot Learning

Zero-Shot Recognition Using Dual Visual-Semantic Mapping Paths.

A novel spatial-frequency domain network for zero-shot incremental learning

Zero-shot learning via visual feature enhancement and dual classifier learning for image recognition

Adaptive multi-scale semantic fusion network for zero-shot learning

Deep Unbiased Embedding Transfer for Zero-shot Learning

Dual Relation Mining Network for Zero-Shot Learning

Dual Part Discovery Network for Zero-Shot Learning

TransZero: Attribute-guided Transformer for Zero-Shot Learning

Dual Expert Distillation Network for Generalized Zero-Shot Learning

Zero-Shot Learning via Discriminative Dual Semantic Auto-Encoder

Multi-level Fusion of Multi-modal Semantic Embeddings for Zero Shot Learning

Deep transductive network for generalized zero shot learning

TransZero++: Cross Attribute-Guided Transformer for Zero-Shot Learning

GNDAN: Graph Navigated Dual Attention Network for Zero-Shot Learning.

Learning Latent Semantic Attributes for Zero-Shot Object Detection.