Abstract:Lying at the interface between Network Science and Machine Learning, node embedding algorithms take a graph as input and encode its structure onto output vectors that represent nodes in an abstract geometric space, enabling various vector-based downstream tasks such as network modelling, data compression, link prediction, and community detection. Two apparently unrelated limitations affect these algorithms. On one hand, it is not clear what the basic operation defining vector spaces, i.e. the vector sum, corresponds to in terms of the original nodes in the network. On the other hand, while the same input network can be represented at multiple levels of resolution by coarse-graining the constituent nodes into arbitrary block-nodes, the relationship between node embeddings obtained at different hierarchical levels is not understood. Here, building on recent results in network renormalization theory, we address these two limitations at once and define a multiscale node embedding method that, upon arbitrary coarse-grainings, ensures statistical consistency of the embedding vector of a block-node with the sum of the embedding vectors of its constituent nodes. We illustrate the power of this approach on two economic networks that can be naturally represented at multiple resolution levels: namely, the international trade between (sets of) countries and the input-output flows among (sets of) industries in the Netherlands. We confirm the statistical consistency between networks retrieved from coarse-grained node vectors and networks retrieved from sums of fine-grained node vectors, a result that cannot be achieved by alternative methods. Several key network properties, including a large number of triangles, are successfully replicated already from embeddings of very low dimensionality, allowing for the generation of faithful replicas of the original networks at arbitrary resolution levels.

Ripple2vec: Node Embedding with Ripple Distance of Structures

Hybrid Embedding via Cross-Layer Random Walks on Multiplex Networks

Distributed Graph Embedding with Information-Oriented Random Walks

Scalable Graph Embedding for Asymmetric Proximity.

Interpreting Node Embedding Distances Through $n$-order Proximity Neighbourhoods

Digraphwave: Scalable Extraction of Structural Node Embeddings via Diffusion on Directed Graphs

Multi-Scale Node Embeddings for Graph Modeling and Generation

Fast and Accurate Network Embeddings via Very Sparse Random Projection

Knowledge Graph Embedding with Diversity of Structures

Voxel2vec: A Natural Language Processing Approach to Learning Distributed Representations for Scientific Data

Het-node2vec: second order random walk sampling for heterogeneous multigraphs embedding

Voxel2vec: A Natural Language Processing Approach to Learning Distributed Representations for Scientific Data.

Virtual network embedding through topology-aware node ranking

HyperS2V: A Framework for Structural Representation of Nodes in Hyper Networks

Structural Node Embeddings with Homomorphism Counts

Network community detection via neural embeddings

Analysis of node2vec random walks on networks

Community Detection Guarantees Using Embeddings Learned by Node2Vec

Network Embedding As Matrix Factorization: Unifying DeepWalk, LINE, PTE, and Node2vec

Towards Understanding and Evaluating Structural Node Embeddings

Learning Based Proximity Matrix Factorization for Node Embedding