Graph Stochastic Neural Process for Inductive Few-shot Knowledge Graph Completion

Zicheng Zhao,Linhao Luo,Shirui Pan,Chengqi Zhang,Chen Gong
2024-08-03
Abstract:Knowledge graphs (KGs) store enormous facts as relationships between entities. Due to the long-tailed distribution of relations and the incompleteness of KGs, there is growing interest in few-shot knowledge graph completion (FKGC). Existing FKGC methods often assume the existence of all entities in KGs, which may not be practical since new relations and entities can emerge over time. Therefore, we focus on a more challenging task called inductive few-shot knowledge graph completion (I-FKGC), where both relations and entities during the test phase are unknown before. Inspired by the idea of inductive reasoning, we cast I-FKGC as an inductive reasoning problem. Specifically, we propose a novel Graph Stochastic Neural Process approach (GS-NP), which consists of two major modules. In the first module, to obtain a generalized hypothesis (e.g., shared subgraph), we present a neural process-based hypothesis extractor that models the joint distribution of hypothesis, from which we can sample a hypothesis for predictions. In the second module, based on the hypothesis, we propose a graph stochastic attention-based predictor to test if the triple in the query set aligns with the extracted hypothesis. Meanwhile, the predictor can generate an explanatory subgraph identified by the hypothesis. Finally, the training of these two modules is seamlessly combined into a unified objective function, of which the effectiveness is verified by theoretical analyses as well as empirical studies. Extensive experiments on three public datasets demonstrate that our method outperforms existing methods and derives new state-of-the-art performance.
Information Retrieval
What problem does this paper attempt to address?
### Problems the Paper Aims to Solve This paper aims to address the issue of Inductive Few-shot Knowledge Graph Completion (I-FKGC) in Knowledge Graphs (KGs). #### Background and Motivation - **Incompleteness of Knowledge Graphs**: Existing knowledge graphs often have a large number of missing factual relationships, which limits their practicality. - **Limitations of Existing Methods**: Current few-shot knowledge graph completion (FKGC) methods often assume that all entities already exist in the knowledge graph. However, in reality, new entities and new relationships continuously emerge, and these methods cannot handle such situations well. #### Specific Problem - **Inductive Few-shot Knowledge Graph Completion (I-FKGC)**: New relationships and new entities that appear during the testing phase are previously unknown, thus requiring a model capable of inductive reasoning to predict the relationships between these new entities. #### Solution - **Proposed Method**: The paper proposes a new method—Graph Stochastic Neural Process (GS-NP), which includes two main modules: - **Neural Process-based Hypothesis Extractor**: Models the joint distribution of hypotheses through neural processes and samples hypotheses from it. - **Graph Stochastic Attention-based Predictor**: Applies the extracted hypotheses to the query set to test whether they conform to the shared hypotheses. #### Main Contributions - Proposed the first inductive few-shot knowledge graph completion method based on the neural process framework. - Designed a predictor based on the graph stochastic attention mechanism, which can effectively handle predictions in few-shot scenarios and provide explanations. - Experimental results on three typical datasets show that this method outperforms existing methods, validating its effectiveness.