Abstract:Few-shot knowledge graph completion (FSKGC) refers to predicting new facts for a new relation with only few-shot observed entity pairs (triples) as support set. Existing solutions to FSKGC mainly conduct the matching process over entity pair representations. Although effective, a major concern of these models is that the entity interactions are not fully explored, based on the observation that they usually generate the pair representation before the matching stage. Such a design inherently overlooks the fine-grained information from entity interactions, leading to performance decrements in one or three shot, which require matching models to capture more sufficient semantic meanings for prediction. To remedy this issue, in this paper, we explore the entity interactions within and between different instances, i.e. , the co-occurrence of two entities, for FSKGC and propose our model named TransAM, Trans former A ppending M atcher. TransAM solves the FSKGC problem by computing the probability of entity sequence with a well-designed transformer matching network. Specifically, TransAM appends query entity pair to serialized reference entity sequence and utilizes transformer to calculate the probability by capturing intra- and inter- triple entity interactions. To bridge the gap between transformer and the triple structure, TransAM introduces rotary operation to preserve the head and tail roles of entity within the triple and distinguishes different triples by a separated triple position encoding. Empirical studies on two public benchmark datasets NELL-One and Wiki-One show that TransAM outperforms existing metric-learning solutions in MRR and with both one- and three- shot settings, and achieves comparable results on five-shot setting. Datasets and code will be public available at https://github.com/gawainx/TransAM.

Position-Aware Relational Transformer for Knowledge Graph Embedding.

Relphormer: Relational Graph Transformer for Knowledge Graph Representations

Bridging Text and Knowledge with Multi-Prototype Embedding for Few-Shot Relational Triple Extraction.

Translating Embeddings for Knowledge Graph Completion with Relation Attention Mechanism.

Relation classification via knowledge graph enhanced transformer encoder

WRTRe: Weighted Relative Position Transformer for Joint Entity and Relation Extraction.

Knowledge Graph Embedding with Diversity of Structures

Reach the Remote Neighbors: Dual-Encoding Transformer for Graphs

HittER: Hierarchical Transformers for Knowledge Graph Embeddings

An attention‐based representation learning model for multiple relational knowledge graph

Improving Static and Temporal Knowledge Graph Embedding Using Affine Transformations of Entities

Transition-based Knowledge Graph Embedding with Relational Mapping Properties

TransAM: Transformer appending matcher for few-shot knowledge graph completion

Learning Entity and Relation Embeddings for Knowledge Graph Completion

Modeling Noncommutative Composition of Relations for Knowledge Graph Embedding

Inductive Relation Prediction from Relational Paths and Context with Hierarchical Transformers

TripleRE: Knowledge Graph Embeddings via Tripled Relation Vectors

Transg : A Generative Model For Knowledge Graph Embedding

TransMS: Knowledge Graph Embedding for Complex Relations by Multidirectional Semantics

Understanding More Knowledge Makes the Transformer Perform Better in Document-level Relation Extraction.