RulE: Knowledge Graph Reasoning with Rule Embedding

Xiaojuan Tang,Song-Chun Zhu,Yitao Liang,Muhan Zhang

2024-05-20

Abstract:Knowledge graph (KG) reasoning is an important problem for knowledge graphs. In this paper, we propose a novel and principled framework called \textbf{RulE} (stands for {Rul}e {E}mbedding) to effectively leverage logical rules to enhance KG reasoning. Unlike knowledge graph embedding (KGE) methods, RulE learns rule embeddings from existing triplets and first-order {rules} by jointly representing \textbf{entities}, \textbf{relations} and \textbf{logical rules} in a unified embedding space. Based on the learned rule embeddings, a confidence score can be calculated for each rule, reflecting its consistency with the observed triplets. This allows us to perform logical rule inference in a soft way, thus alleviating the brittleness of logic. On the other hand, RulE injects prior logical rule information into the embedding space, enriching and regularizing the entity/relation embeddings. This makes KGE alone perform better too. RulE is conceptually simple and empirically effective. We conduct extensive experiments to verify each component of RulE. Results on multiple benchmarks reveal that our model outperforms the majority of existing embedding-based and rule-based approaches.

Artificial Intelligence,Machine Learning

What problem does this paper attempt to address?

The paper aims to address issues in Knowledge Graph Reasoning (KGR), particularly how to effectively utilize logical rules to enhance KGR performance. Specifically, the paper proposes a new framework called RulE, which addresses the problems in existing methods through the following ways:

1. **Integration of Logical Rules and Embedding Methods**: Traditional knowledge graph embedding methods (such as TransE, RotatE, etc.) only use zero-order logic (i.e., facts about specific entities) and do not explicitly utilize first-order logical rules. On the other hand, rule-based knowledge graph reasoning can perform interpretable reasoning and generalize to new entities, but the fragility of its logical rules severely affects prediction performance. RulE effectively combines the advantages of both by embedding entities, relations, and logical rules into a unified space.

2. **Improving the Quality of Embedding Representations**: By jointly training the embeddings of entities, relations, and logical rules, RulE can inject prior logical rule information into the embedding space, thereby enriching and regularizing the embedding representations, and consequently improving the performance of embedding-based methods themselves.

3. **Soft Rule Reasoning**: RulE can not only compute confidence scores for each logical rule based on the learned relation and rule embeddings but also perform "soft" logical rule reasoning based on these scores, thus alleviating the fragility issues of traditional logical rule reasoning.

Experimental results show that RulE outperforms existing embedding-based and rule-based methods on multiple benchmark datasets and demonstrates the effectiveness of its components.