Abstract:Knowledge graph embeddings represent a group of machine learning techniques which project entities and relations of a knowledge graph to continuous vector spaces. RDF2vec is a scalable embedding approach rooted in the combination of random walks with a language model. It has been successfully used in various applications. Recently, multiple variants to the RDF2vec approach have been proposed, introducing variations both on the walk generation and on the language modeling side. The combination of those different approaches has lead to an increasing family of RDF2vec variants. In this paper, we evaluate a total of twelve RDF2vec variants on a comprehensive set of benchmark models, and compare them to seven existing knowledge graph embedding methods from the family of link prediction approaches. Besides the established GEval benchmark introducing various downstream machine learning tasks on the DBpedia knowledge graph, we also use the new DLCC (Description Logic Class Constructors) benchmark consisting of two gold standards, one based on DBpedia, and one based on synthetically generated graphs. The latter allows for analyzing which ontological patterns in a knowledge graph can actually be learned by different embedding. With this evaluation, we observe that certain tailored RDF2vec variants can lead to improved performance on different downstream tasks, given the nature of the underlying problem, and that they, in particular, have a different behavior in modeling similarity and relatedness. The findings can be used to provide guidance in selecting a particular RDF2vec method for a given task.

Global RDF Vector Space Embeddings

Using Context-to-Vector with Graph Retrofitting to Improve Word Embeddings

The RDF2vec family of knowledge graph embedding methods

word2vec, node2vec, graph2vec, X2vec: Towards a Theory of Vector Embeddings of Structured Data

Topic Modeling Using Distributed Word Embeddings

Parallel Vector Field Embedding.

Utility of General and Specific Word Embeddings for Classifying Translational Stages of Research

Visual Word2Vec (vis-w2v): Learning Visually Grounded Word Embeddings Using Abstract Scenes

Bike2Vec: Vector Embedding Representations of Road Cycling Riders and Races

GeoVectors: A Linked Open Corpus of OpenStreetMap Embeddings on World Scale

highway2vec -- representing OpenStreetMap microregions with respect to their road network characteristics

Walk this Way! Entity Walks and Property Walks for RDF2vec

Embedding Words in Non-Vector Space with Unsupervised Graph Learning

Efficient Non-parametric Estimation of Multiple Embeddings per Word in Vector Space

Enriching Word Embeddings with Temporal and Spatial Information

Import2vec - Learning Embeddings for Software Libraries

Urban2Vec: Incorporating Street View Imagery and POIs for Multi-Modal Urban Neighborhood Embedding

Company2Vec -- German Company Embeddings based on Corporate Websites

Analyzing Structures in the Semantic Vector Space: A Framework for Decomposing Word Embeddings

Linking GloVe with Word2vec

AutoRDF2GML: Facilitating RDF Integration in Graph Machine Learning