Abstract:Zero-shot and few-shot learning aim to improve generalization to unseen concepts, which are promising in many realistic scenarios. Due to the lack of data in unseen domain, relation modeling between seen and unseen domains is vital for knowledge transfer in these tasks. Most existing methods capture seen-unseen relationimplicitly via semantic embedding or feature generation, resulting in inadequate use of relation and some issues remain (e.g. domain shift). To tackle these challenges, we propose a Transferable Graph Generation (TGG ) approach, in which the relation is modeled and utilizedexplicitly via graph generation. Specifically, our proposed TGG contains two main components: (1) Graph generation for relation modeling. Anattention-based aggregate network and arelation kernel are proposed, which generate instance-level graph based on a class-level prototype graph and visual features. Proximity information aggregating is guided by a multi-head graph attention mechanism, where seen and unseen features synthesized by GAN are revised as node embeddings. The relation kernel further generates edges with GCN and graph kernel method, to capture instance-level topological structure while tackling data imbalance and noise. (2) Relation propagation for relation utilization. Adual relation propagation approach is proposed, where relations captured by the generated graph are separately propagated from the seen and unseen subgraphs. The two propagations learn from each other in a dual learning fashion, which performs as an adaptation way for mitigating domain shift. All components are jointly optimized with a meta-learning strategy, and our TGG acts as an end-to-end framework unifying conventional zero-shot, generalized zero-shot and few-shot learning. Extensive experiments demonstrate that it consistently surpasses existing methods of the above three fields by a significant margin.

Zero-Shot Scene Graph Generation with Knowledge Graph Completion

Zero-Shot Visual Question Answering Using Knowledge Graph

Zero-shot and Few-shot Learning with Knowledge Graphs: A Comprehensive Survey

Explainable Zero-Shot Learning Via Attentive Graph Convolutional Network And Knowledge Graphs

Fast Contextual Scene Graph Generation with Unbiased Context Augmentation.

Towards Unseen Triples: Effective Text-Image-joint Learning for Scene Graph Generation

Reasoning in Different Directions: Triplet Learning for Scene Graph Generation

OntoZSL: Ontology-enhanced Zero-shot Learning

Generative Adversarial Zero-shot Learning via Knowledge Graphs

Multi-Label Zero-Shot Learning with Structured Knowledge Graphs

Benchmarking Knowledge-driven Zero-shot Learning

Semantic-visual shared knowledge graph for zero-shot learning

K-ZSL: Resources for Knowledge-driven Zero-shot Learning

One-shot Scene Graph Generation

Recognizing Unseen Objects via Multimodal Intensive Knowledge Graph Propagation

A Structure-Enhanced Generative Adversarial Network for Knowledge Graph Zero-Shot Relational Learning.

Scene Graph Generation With External Knowledge and Image Reconstruction

Zero-Shot Relational Learning for Multimodal Knowledge Graphs

Towards Lifelong Scene Graph Generation with Knowledge-ware In-context Prompt Learning

Zero-shot Learning Via Shared-Reconstruction-Graph Pursuit

TGG: Transferable Graph Generation for Zero-shot and Few-shot Learning