Abstract:Dealing with relational data always required significant computational resources, domain expertise and task-dependent feature engineering to incorporate structural information into a predictive model. Nowadays, a family of automated graph feature engineering techniques has been proposed in different streams of literature. So-called graph embeddings provide a powerful tool to construct vectorized feature spaces for graphs and their components, such as nodes, edges and subgraphs under preserving inner graph properties. Using the constructed feature spaces, many machine learning problems on graphs can be solved via standard frameworks suitable for vectorized feature representation. Our survey aims to describe the core concepts of graph embeddings and provide several taxonomies for their description. First, we start with the methodological approach and extract three types of graph embedding models based on matrix factorization, random-walks and deep learning approaches. Next, we describe how different types of networks impact the ability of models to incorporate structural and attributed data into a unified embedding. Going further, we perform a thorough evaluation of graph embedding applications to machine learning problems on graphs, among which are node classification, link prediction, clustering, visualization, compression, and a family of the whole graph embedding algorithms suitable for graph classification, similarity and alignment problems. Finally, we overview the existing applications of graph embeddings to computer science domains, formulate open problems and provide experiment results, explaining how different networks properties result in graph embeddings quality in the four classic machine learning problems on graphs, such as node classification, link prediction, clustering and graph visualization. As a result, our survey covers a new rapidly growing field of network feature engineering, presents an in-depth analysis of models based on network types, and overviews a wide range of applications to machine learning problems on graphs.

word2vec, node2vec, graph2vec, X2vec: Towards a Theory of Vector Embeddings of Structured Data

Knowledge Graph Embedding with Diversity of Structures

Topic Modeling Using Distributed Word Embeddings

motif2vec: Motif Aware Node Representation Learning for Heterogeneous Networks

Embeddings and Representation Learning for Structured Data

Analyzing Structures in the Semantic Vector Space: A Framework for Decomposing Word Embeddings

Survey on graph embeddings and their applications to machine learning problems on graphs

From communities to interpretable network and word embedding: an unified approach

Embedding Words in Non-Vector Space with Unsupervised Graph Learning

Global RDF Vector Space Embeddings

Metric Distribution to Vector: Constructing Data Representation via Broad-Scale Discrepancies

Towards Understanding and Evaluating Structural Node Embeddings

From Word Vectors to Multimodal Embeddings: Techniques, Applications, and Future Directions For Large Language Models

struc2vec: Learning Node Representations from Structural Identity

Unsupervised Framework for Evaluating and Explaining Structural Node Embeddings of Graphs

Bike2Vec: Vector Embedding Representations of Road Cycling Riders and Races

Utility of General and Specific Word Embeddings for Classifying Translational Stages of Research

A Vectorization Approach for Graph-Structured Data to Pattern Recognition.

Gram2Vec: An Interpretable Document Vectorizer

GraphViz2Vec: A Structure-aware Feature Generation Model to Improve Classification in GNNs