Abstract:In recent years, knowledge graph representation learning has prompted extensive research. Machine learning models are used to map entity and relational data in knowledge graphs to vector representations in low-dimensional spaces to predict and analyze potential relationships. Current works mainly focus on the knowledge representation of the triple structure and relationship path in knowledge graphs without fully utilizing external textual information to semantically supplement knowledge representation. However, the existing knowledge inventory, such as that for smart health and emotion care systems, is relatively meager, and structural knowledge is incomplete; therefore, knowledge graph completion is essential. In this article, we propose a novel joint representation learning model that introduces text description information and extracts reliable feature information from text data by using a convolutional neural network (CNN) model. Furthermore, being based on the attention mechanism, the proposed model distinguishes the characteristic credibility of different relationships, enhances the representation of the entity relationship structure vector in the existing knowledge graph, and obtains rich semantic information. Finally, the 2-D convolution operation is used to process the joint representation vectors of entities and relationships to obtain nonlinear features, and the knowledge graph is completed by completing the calculation of the score function of the joint representation vector of the entity and the relationship. Experiments performing tasks, such as link prediction and triple classification, on the FreeBase (FB15k), WordNet (WN18) and Yet Another Great Ontology (YAGO3-10) data sets reveal that our model performs better than the benchmark model and has some degree of scalability.

Towards Knowledge Enhanced Language Model for Machine Reading Comprehension

Enhancing Pre-Trained Language Representations with Rich Knowledge for Machine Reading Comprehension

Mixed Geometry Message and Trainable Convolutional Attention Network for Knowledge Graph Completion

CGKPN: Cross-Graph Knowledge Propagation Network with Adaptive Connection for Reasoning-Based Machine Reading Comprehension

Chinese Machine Reading Comprehension Based on Language Model Containing Knowledge.

Commonsense Knowledge Base Completion with Relational Graph Attention Network and Pre-trained Language Model

KGNER: Improving Chinese Named Entity Recognition by BERT Infused with the Knowledge Graph

CAT-BERT: A Context-Aware Transferable BERT Model for Multi-turn Machine Reading Comprehension.

Towards Robust Knowledge Graph Embedding via Multi-task Reinforcement Learning

Convolutional Network Embedding of Text-Enhanced Representation for Knowledge Graph Completion

Graph Structure Enhanced Pre-Training Language Model for Knowledge Graph Completion

MEGA: Meta-Graph Augmented Pre-Training Model for Knowledge Graph Completion

Joint Knowledge Base Embedding with Neighborhood Context

KELM: Knowledge Enhanced Pre-Trained Language Representations with Message Passing on Hierarchical Relational Graphs

Pingan Smart Health and SJTU at COIN - Shared Task: Utilizing Pre-trained Language Models and Common-sense Knowledge in Machine Reading Tasks

Step out of KG: Knowledge Graph Completion via Knowledgeable Retrieval and Reading Comprehension

Incorporating External Knowledge to Boost Machine Comprehension Based Question Answering.

Learning Knowledge-Enhanced Contextual Language Representations for Domain Natural Language Understanding

Bi-directional Cognitive Thinking Network for Machine Reading Comprehension

KFCNet: Knowledge Filtering and Contrastive Learning Network for Generative Commonsense Reasoning

KICGPT: Large Language Model with Knowledge in Context for Knowledge Graph Completion