Abstract:Link prediction is a key technique for connecting entities and relationships in a graph reasoning field. It leverages known information about the graph structure data to predict missing factual information. Previous studies have either focused on the semantic representation of a single triplet or on the graph structure data built on triples. The former ignores the association between different triples, and the latter ignores the true meaning of the node itself. Furthermore, common graph-structured datasets inherently face challenges, such as missing information and incompleteness. In light of this challenge, we present a novel model called Multi-source Information Graph Embedding with Ensemble Learning for Link Prediction (EMGE), which can effectively improve the reasoning of link prediction. Ensemble learning is systematically applied throughout the model training process. At the data level, this approach enhances entity embeddings by integrating structured graph information and unstructured textual data as multi-source information inputs. The fusion of these inputs is effectively addressed by introducing an attention mechanism. During the training phase, the principle of ensemble learning is employed to extract semantic features from multiple neural network models, facilitating the interaction of enriched information. To ensure effective model learning, a novel loss function based on contrastive learning is devised, effectively minimizing the discrepancy between predicted values and the ground truth. Moreover, to enhance the semantic representation of graph nodes in link prediction, two rules are introduced during the aggregation of graph structure information. These rules incorporate the concept of spreading activation, enabling a more comprehensive understanding of the relationships between nodes and edges in the graph. During the testing phase, the EMGE model is validated on three datasets, including WN18RR, FB15k-237, and a private Chinese financial dataset. The experimental results demonstrate a reduction in the mean rank (MR) by 0.2 times, an improvement in the mean reciprocal rank (MRR) by 5.9%, and an increase in the Hit@1 by 12.9% compared to the baseline model.

Knowledge graph embeddings based on 2d convolution and self-attention mechanisms for link prediction

Convolutional Models with Multi-Feature Fusion for Effective Link Prediction in Knowledge Graph Embedding

Self-attention Presents Low-dimensional Knowledge Graph Embeddings for Link Prediction

Convolutional 2D Knowledge Graph Embeddings

Knowledge graph embedding by logical-default attention graph convolution neural network for link prediction

Knowledge graph embedding model with attention-based high-low level features interaction convolutional network

Knowledge graph embedding based on dynamic adaptive atrous convolution and attention mechanism for link prediction

Semi-supervised Training for Knowledge Base Graph Self-attention Networks on Link Prediction

A knowledge graph embedding model based attention mechanism for enhanced node information integration

Hypernetwork Knowledge Graph Embeddings

Link Prediction in Knowledge Graphs Based on Hyperbolic Graph Attention Networks

Knowledge graph embedding by relational rotation and complex convolution for link prediction

Multi-Source Information Graph Embedding with Ensemble Learning for Link Prediction

Link prediction based on feature representation and fusion

JointE: Jointly utilizing 1D and 2D convolution for knowledge graph embedding

Explicit and Implicit Feature Contrastive Learning Model for Knowledge Graph Link Prediction

Effective Model Integration Algorithm for Improving Link and Sign Prediction in Complex Networks

Location Based Link Prediction for Knowledge Graph

Knowledge graph completion method for hydraulic engineering coupled with spatial transformation and an attention mechanism

Improving Entity Linking with Graph Networks