Uncertainty-Aware Relational Graph Neural Network for Few-Shot Knowledge Graph Completion

Qian Li,Shu Guo,Yinjia Chen,Cheng Ji,Jiawei Sheng,Jianxin Li
2024-03-21
Abstract:Few-shot knowledge graph completion (FKGC) aims to query the unseen facts of a relation given its few-shot reference entity pairs. The side effect of noises due to the uncertainty of entities and triples may limit the few-shot learning, but existing FKGC works neglect such uncertainty, which leads them more susceptible to limited reference samples with noises. In this paper, we propose a novel uncertainty-aware few-shot KG completion framework (UFKGC) to model uncertainty for a better understanding of the limited data by learning representations under Gaussian distribution. Uncertainty representation is first designed for estimating the uncertainty scope of the entity pairs after transferring feature representations into a Gaussian distribution. Further, to better integrate the neighbors with uncertainty characteristics for entity features, we design an uncertainty-aware relational graph neural network (UR-GNN) to conduct convolution operations between the Gaussian distributions. Then, multiple random samplings are conducted for reference triples within the Gaussian distribution to generate smooth reference representations during the optimization. The final completion score for each query instance is measured by the designed uncertainty optimization to make our approach more robust to the noises in few-shot scenarios. Experimental results show that our approach achieves excellent performance on two benchmark datasets compared to its competitors.
Computation and Language
What problem does this paper attempt to address?
### Problems Addressed by the Paper This paper primarily aims to address the issue of uncertainty in **Few-Shot Knowledge Graph Completion (FKGC)**. Specifically: 1. **Problem Background**: - Knowledge Graphs (KGs) typically contain a large number of entities and their relationships, but they still suffer from incompleteness, meaning many entities and relationships are missing. - Traditional knowledge graph completion methods require a large amount of training data to learn representations for each relationship. However, in real-world scenarios, existing knowledge graphs often face the long-tail problem, where many relationships appear infrequently and lack sufficient training samples. - The task of Few-Shot Knowledge Graph Completion (FKGC) aims to predict unknown facts by given a small number of reference entity pairs. 2. **Main Challenges**: - Impact of noise: Due to the uncertainty of entities and triples, noise may limit the effectiveness of few-shot learning. Existing FKGC methods ignore this uncertainty, making them more vulnerable in the face of limited and noisy reference samples. 3. **Proposed Method**: - This paper proposes a novel uncertainty-aware few-shot knowledge graph completion framework (UFKGC), which uses Gaussian distribution to model uncertainty and better understand limited data. - By designing uncertainty representations to estimate the uncertainty range of entity pairs, and further designing an uncertainty-aware relational graph neural network (UR-GNN) to perform convolution operations. - Multiple random samplings are conducted during the optimization process to generate smooth reference representations, and uncertainty optimization is designed to improve the robustness of the method to noise. 4. **Experimental Results**: - Experiments show that this method achieves excellent performance on two benchmark datasets, outperforming existing competitors. In summary, this paper aims to improve the task of few-shot knowledge graph completion by introducing uncertainty modeling, thereby enhancing the robustness and effectiveness of the model in limited sample scenarios.