Abstract:Most existing knowledge graphs suffer from incompleteness. Embedding knowledge graphs into continuous vector spaces has recently attracted increasing interest in knowledge base completion. However, in most existing embedding methods, only fact triplets are utilized, and logical rules have not been thoroughly studied for the knowledge base completion task. To overcome the problem, we propose an association rules enhanced knowledge graph attention network (AR-KGAT). The AR-KGAT captures both entity and relation features for high-order neighborhoods of any given entity in an end-to-end manner under the graph attention network framework. The major component of AR-KGAT is an encoder of an effective neighborhood aggregator, which addresses the problems by aggregating neighbors with both association-rules-based and graph-based attention weights. Additionally, the proposed model also encapsulates the representations from multi-hop neighbors of nodes to refine their embeddings. The decoder enables AR-KGAT to be translational between entities and relations while keeping the superior link prediction performance. A logic-like inference pattern is utilized as constraints for knowledge graph embedding. Then, the global loss is minimized over both atomic and complex formulas to achieve the embedding task. In this manner, we learn embeddings compatible with triplets and rules, which are certainly more predictive for knowledge acquisition and inference. We conduct extensive experiments on two benchmark datasets: WN18RR and FB15k-237, for two knowledge graph completion tasks: the link prediction and triplet classification to evaluate the proposed AR-KGAT model. The results show that the proposed AR-KGAT model achieves significant and consistent improvements over state-of-the-art methods.

Advancing rule learning in knowledge graphs with structure-aware graph transformer

Ruleformer: Context-aware Rule Mining over Knowledge Graph.

A Comprehensive Study on Knowledge Graph Embedding over Relational Patterns Based on Rule Learning

Iteratively Learning Embeddings and Rules for Knowledge Graph Reasoning

Knowledge Reasoning via Jointly Modeling Knowledge Graphs and Soft Rules

Learning Typed Rules over Knowledge Graphs

RMNA: A Neighbor Aggregation-Based Knowledge Graph Representation Learning Model Using Rule Mining

Understanding Expressivity of Neural KG Reasoning from Rule Structure Learning

RulE: Neural-Symbolic Knowledge Graph Reasoning with Rule Embedding

Rule-based data augmentation for knowledge graph embedding

Ruleformer: Context-aware Differentiable Rule Mining over Knowledge Graph

Logic Rules Powered Knowledge Graph Embedding

Neural Compositional Rule Learning for Knowledge Graph Reasoning

RulE: Knowledge Graph Reasoning with Rule Embedding

ChatRule: Mining Logical Rules with Large Language Models for Knowledge Graph Reasoning

Learning Rules from KGs Guided by Language Models

Association Rules Enhanced Knowledge Graph Attention Network

RLogic: Recursive Logical Rule Learning from Knowledge Graphs

Differentiable Learning of Graph-like Logical Rules from Knowledge Graphs

Rule mining over knowledge graphs via reinforcement learning

Simple Augmentations of Logical Rules for Neuro-Symbolic Knowledge Graph Completion