Abstract:Zero-shot learning (ZSL) tackles the unseen class recognition problem by transferring semantic knowledge from seen classes to unseen ones. Typically, to guarantee desirable knowledge transfer, a direct embedding is adopted for associating the visual and semantic domains in ZSL. However, most existing ZSL methods focus on learning the embedding from implicit global features or image regions to the semantic space. Thus, they fail to: 1) exploit the appearance relationship priors between various local regions in a single image, which corresponds to the semantic information and 2) learn cooperative global and local features jointly for discriminative feature representations. In this article, we propose the novel graph navigated dual attention network (GNDAN) for ZSL to address these drawbacks. GNDAN employs a region-guided attention network (RAN) and a region-guided graph attention network (RGAT) to jointly learn a discriminative local embedding and incorporate global context for exploiting explicit global embeddings under the guidance of a graph. Specifically, RAN uses soft spatial attention to discover discriminative regions for generating local embeddings. Meanwhile, RGAT employs an attribute-based attention to obtain attribute-based region features, where each attribute focuses on the most relevant image regions. Motivated by the graph neural network (GNN), which is beneficial for structural relationship representations, RGAT further leverages a graph attention network to exploit the relationships between the attribute-based region features for explicit global embedding representations. Based on the self-calibration mechanism, the joint visual embedding learned is matched with the semantic embedding to form the final prediction. Extensive experiments on three benchmark datasets demonstrate that the proposed GNDAN achieves superior performances to the state-of-the-art methods. Our code and trained models are available at https://github.com/shiming-chen/GNDAN.

Knowledge-Experience Graph with Denoising Autoencoder for Zero-Shot Learning in Visual Cognitive Development.

Explainable Zero-Shot Learning Via Attentive Graph Convolutional Network And Knowledge Graphs

Knowledge Distillation Classifier Generation Network for Zero-Shot Learning

Zero-Shot Visual Question Answering Using Knowledge Graph

Semantic Enhanced Knowledge Graph for Large-Scale Zero-Shot Learning

Zero-shot and Few-shot Learning with Knowledge Graphs: A Comprehensive Survey

Class knowledge overlay to visual feature learning for zero-shot image classification

Semantic-visual shared knowledge graph for zero-shot learning

A dynamic semantic knowledge graph for zero-shot object detection

Multi-Label Zero-Shot Learning with Structured Knowledge Graphs

Generative Adversarial Zero-shot Learning via Knowledge Graphs

Recognizing Unseen Objects via Multimodal Intensive Knowledge Graph Propagation

Disentangled Ontology Embedding for Zero-shot Learning

Knowledge-aware Zero-Shot Learning: Survey and Perspective

Boosting Audio-visual Zero-shot Learning with Large Language Models

Multi-modal Generative Adversarial Network for Zero-Shot Learning

Meta-Transfer Networks for Zero-Shot Learning

Promoting Machine Abilities of Discovering and Utilizing Knowledge in a Unified Zero-shot Learning Paradigm

GNDAN: Graph Navigated Dual Attention Network for Zero-Shot Learning.

GAN for Vision, KG for Relation: a Two-stage Deep Network for Zero-shot Action Recognition

Knowledge-Guided Semantic Transfer Network for Few-Shot Image Recognition