Abstract:The incompleteness of knowledge graphs triggers considerable research interest in relation prediction. As the key to predicting relations among entities, many efforts have been devoted to learning the embeddings of entities and relations by incorporating a variety of neighbors' information which includes not only the information from direct outgoing and incoming neighbors but also the ones from the indirect neighbors on the multihop paths. However, previous models usually consider entity paths of limited length or ignore sequential information of the paths. Either simplification will make the model lack a global understanding of knowledge graphs and may result in the loss of important and indispensable information. In this article, we propose a novel global graph attention embedding network (GGAE) for relation prediction by combining global information from both direct neighbors and multihop neighbors. Concretely, given a knowledge graph, we first introduce the path construction algorithms to obtain meaningful paths, then design path modeling methods to capture the potential long-distance sequential information in the multihop paths, final propose an entity graph attention and a relation graph attention mechanisms to obtain entity embeddings and relation embeddings. Moreover, an entity graph attention mechanism is proposed to calculate the entity embeddings by aggregating direct incoming and outgoing neighbors from: 1) an original knowledge graph with the original entity and relation embeddings and 2) a new knowledge graph constructed by the paths whose embeddings are updated by path modeling methods. for each relation, we construct a new graph with related entities and present a relation graph attention to learn the features. Therefore, our model can encapsulate the information from different distance neighbors, and enable the embeddings of entities and relations to better capture all-sided semantic information. The experimental results on bench-ark datasets verify the superiority of our model over the state-of-the-art ones.

Knowledge Graph Embedding Via Graph Attenuated Attention Networks

A knowledge graph embedding model based attention mechanism for enhanced node information integration

GAEAT: Graph Auto-Encoder Attention Networks for Knowledge Graph Completion

Learning graph attention-aware knowledge graph embedding

A Knowledge Graph Embedding Method Based on Neural Network

Adaptive Attention-based Knowledge Graph Completion

Association Rules Enhanced Knowledge Graph Attention Network

GGAT: Knowledge Graph Embedding Model Via Global Information

Global Graph Attention Embedding Network for Relation Prediction in Knowledge Graphs

Attention-Based Aggregation Graph Networks for Knowledge Graph Information Transfer

KTAT: A Complex Embedding Model of Knowledge Graph Integrating Type Information and Attention Mechanism

Global Relation Auxiliary Graph Attention Network for Knowledge Graph Completion

Learning knowledge graph embedding with a dual-attention embedding network

A Deep Embedding Model for Knowledge Graph Completion Based on Attention Mechanism.

Hierarchical Perceptual Graph Attention Network for Knowledge Graph Completion

A Contrastive Knowledge Graph Embedding Model with Hierarchical Attention and Dynamic Completion

Knowledge Graph Embedding Using a Multi-Channel Interactive Convolutional Neural Network with Triple Attention

Knowledge graph embedding based on dynamic adaptive atrous convolution and attention mechanism for link prediction

A data-centric framework of improving graph neural networks for knowledge graph embedding

Neighbor-Augmented Knowledge Graph Attention Network for Recommendation

Multi-relational graph attention networks for knowledge graph completion