Abstract:Purpose: Due to the incompleteness nature of knowledge graphs（KGs）, the task of predicting missing links between entities becomes important. Many previous approaches are static, this posed a notable problem that all meanings of a polysemous entity share one embedding vector. This study aims to propose a polysemous embedding approach, named KG embedding under relational contexts（Cont E for short）, for missing link prediction. Design/methodology/approach: Cont E models and infers different relationship patterns by considering the context of the relationship, which is implicit in the local neighborhood of the relationship. The forward and backward impacts of the relationship in Cont E are mapped to two different embedding vectors, which represent the contextual information of the relationship. Then, according to the position of the entity, the entity’s polysemous representation is obtained by adding its static embedding vector to the corresponding context vector of the relationship. Findings: Cont E is a fully expressive, that is, given any ground truth over the triples, there are embedding assignments to entities and relations that can precisely separate the true triples from false ones. Cont E is capable of modeling four connectivity patterns such as symmetry, antisymmetry, inversion and composition. Research limitations: Cont E needs to do a grid search to find best parameters to get best performance in practice, which is a time-consuming task. Sometimes, it requires longer entity vectors to get better performance than some other models.Practical implications: Cont E is a bilinear model, which is a quite simple model that could be applied to large-scale KGs. By considering contexts of relations, Cont E can distinguish the exact meaning of an entity in different triples so that when performing compositional reasoning, it is capable to infer the connectivity patterns of relations and achieves good performance on link prediction tasks.Originality/value: Cont E considers the contexts of entities in terms of their positions in triples and the relationships they link to. It decomposes a relation vector into two vectors, namely, forward impact vector and backward impact vector in order to capture the relational contexts. Cont E has the same low computational complexity as Trans E. Therefore, it provides a new approach for contextualized knowledge graph embedding.

Learning word embeddings from dependency relations

Using Context-to-Vector with Graph Retrofitting to Improve Word Embeddings

Learning Context-based Embeddings for Knowledge Graph Completion

Unsupervised Word and Dependency Path Embeddings for Aspect Term Extraction

Learning Context-Specific Word/Character Embeddings.

Learning Semantic Representations for Novel Words: Leveraging Both Form and Context

Learning Word Embeddings from Intrinsic and Extrinsic Views

Learning Effective Word Embedding Using Morphological Word Similarity

Syntactic word embedding based on dependency syntax and polysemous analysis

Enhancing Semantic Representations of Bilingual Word Embeddings with Syntactic Dependencies

Learning Word Embedding with Better Distance Weighting and Window Size Scheduling

Word Embedding Representation with Synthetic Position and Context Information for Relation Extraction

Joint Learning of Character and Word Embeddings.

Lexical semantics enhanced neural word embeddings

Dependency-based Convolutional Neural Networks for Sentence Embedding

Learning Word Sense Embeddings from Word Sense Definitions

Learning word representation by jointly using neighbor and syntactic contexts

Learning Chinese Word Embeddings from Stroke, Structure and Pinyin of Characters

Enhancing Semantic Word Representations by Embedding Deeper Word Relationships

A Semantic Relation Preserved Word Embedding Reuse Method

Learning Word Representations by Jointly Modeling Syntagmatic and Paradigmatic Relations.