Abstract:Relation prediction is a critical task in knowledge graph completion and associated downstream tasks that rely on knowledge representation. Previous studies indicate that both structural features and semantic information are meaningful for predicting missing relations in knowledge graphs. This has led to the development of two types of methods: structure-based methods and semantics-based methods. Since these two approaches represent two distinct learning paradigms, it is difficult to fully utilize both sets of features within a single learning model, especially deep features. As a result, existing studies usually focus on only one type of feature. This leads to an insufficient representation of knowledge in current methods and makes them prone to overlooking certain patterns when predicting missing relations. In this study, we introduce a novel model, RP-ISS, which combines deep semantic and structural features for relation prediction. The RP-ISS model utilizes a two-part architecture, with the first component being a RoBERTa module that is responsible for extracting semantic features from entity nodes. The second part of the system employs an edge-based relational message-passing network designed to capture and interpret structural information within the data. To alleviate the computational burden of the message-passing network on the RoBERTa module during the sampling process, RP-ISS introduces a node embedding memory bank, which updates asynchronously to circumvent excessive computation. The model was assessed on three publicly accessible datasets (WN18RR, WN18, and FB15k-237), and the results revealed that RP-ISS surpasses all baseline methods across all evaluation metrics. Moreover, RP-ISS showcases robust performance in graph inductive learning.

Multivariate Prediction for Learning on the Semantic Web

Multivariate Prediction for Learning in Relational Graphs

Model Semantic Relations with Extended Attributes

Towards Machine Learning on the Semantic Web

Learning a Probabilistic Semantic Model from Heterogeneous Social Networks for Relationship Identification

A Scalable Approach for Statistical Learning in Semantic Graphs

Going Beyond Multi-Task Dense Prediction with Synergy Embedding Models

Generalized Relation Learning with Semantic Correlation Awareness for Link Prediction

Scalable Relation Prediction Exploiting Both Intrarelational Correlation and Contextual Information.

Social network mashup: Ontology-based social network integration for statistic learning

Materializing and Querying Learned Knowledge

Combining information extraction, deductive reasoning and machine learning for relation prediction

Semantic Text Mining with Linked Data

Learning Word Representations from Relational Graphs

A novel model for relation prediction in knowledge graphs exploiting semantic and structural feature integration

A Method to Predict Semantic Relations on Artificial Intelligence Papers

Dynamic Multivariate Functional Data Modeling Via Sparse Subspace Learning

Understanding, Categorizing and Predicting Semantic Image-Text Relations

Multi-task Neural Network for Non-discrete Attribute Prediction in Knowledge Graphs

Semantic TrueLearn: Using Semantic Knowledge Graphs in Recommendation Systems

Relation Prediction in Multi-Relational Domains using Matrix Factorization