Introducing Graph Neural Networks for Few-Shot Relation Prediction in Knowledge Graph Completion Task

Yashen Wang,Huanhuan Zhang
DOI: https://doi.org/10.1007/978-3-030-82136-4_24
2021-01-01
Abstract:Relation prediction is a key problem for graph-structured data, to many applications such as knowledge graph completion (KGC), while embedding-based methods, effective for relation prediction in KGs, perform poorly on relations that only have a few associative triples. Nowadays, many works focus on leveraging Graph Neural Network (GNN) for alleviating few-shot learning problems in relation prediction task. However, existing work usually only averages the neighbors of the target nodes, which limits model's performance and capability. Besides, although the Graph Attention Network (GAT) can generate more powerful feature representations through the expansion of multi-head attention, unfortunately it only considers the relationship between neighbors in the same layer, and does not make full use of hierarchical information (e.g., layer-wise information), resulting in excessive over-smoothing problem. Hence, this paper develops a novel GNN-based model for few-shot relation prediction, by leveraging intra-layer neighborhood attention and inter-layer memory attention, to alleviate over-smoothing tendencies of deep GNNs. Empirical studies on two real-world datasets confirm the superiority of the proposed model. The proposed model addresses the few-shot relation prediction and outperforms competitive state-of-the-art models.
What problem does this paper attempt to address?