Abstract:Modelling information from complex systems such as humans social interaction or words co-occurrences in our languages can help to understand how these systems are organized and function. Such systems can be modelled by networks, and network theory provides a useful set of methods to analyze them. Among these methods, graph embedding is a powerful tool to summarize the interactions and topology of a network in a vectorized feature space. When used in input of machine learning algorithms, embedding vectors help with common graph problems such as link prediction, graph matching, etc In Natural Language Processing (NLP), such a vectorization process is also employed. Word embedding has the goal of representing the sense of words, extracting it from large text corpora. Despite differences in the structure of information in input of embedding algorithms, many graph embedding approaches are adapted and inspired from methods in NLP. Limits of these methods are observed in both domains. Most of these methods require long and resource greedy training. Another downside to most methods is that they are black-box , from which understanding how the information is structured is rather complex. Interpretability of a model allows understanding how the vector space is structured without the need for external information, and thus can be audited more easily. With both these limitations in mind, we propose a novel framework to efficiently embed network vertices in an interpretable vector space. Our Lower Dimension Bipartite Framework (LDBGF) leverages the bipartite projection of a network using cliques to reduce dimensionality. Along with LDBGF, we introduce two implementations of this framework that rely on communities instead of cliques: SINr-NR and SINr-MF. We show that SINr-MF can perform well on classical graphs and SINr-NR can produce high-quality graph and word embeddings that are interpretable and stable across runs.

The Immersion of Directed Multi-graphs in Embedding Fields. Generalisations

Multi-view Heterogeneous Fusion and Embedding for Categorical Attributes on Mixed Data.

Towards conceptual generalization in the embedding space

Knowledge Graph Embedding with Diversity of Structures

DUPLEX: Dual GAT for Complex Embedding of Directed Graphs

Transformers Meet Directed Graphs

Graph Embedding with Constraints

Dissecting embedding method: learning higher-order structures from data

Dual-Geometric Space Embedding Model for Two-View Knowledge Graphs.

Learning Latent Disentangled Embeddings and Graphs for Multi-View Clustering

From communities to interpretable network and word embedding: an unified approach

High-Dimensional Undirected Graphical Models for Arbitrary Mixed Data

MS-IMAP -- A Multi-Scale Graph Embedding Approach for Interpretable Manifold Learning

The Geometry of Distributed Representations for Better Alignment, Attenuated Bias, and Improved Interpretability

ModulE: Module Embedding for Knowledge Graphs

Geometric Relational Embeddings: A Survey

Asymmetric Transitivity Preserving Graph Embedding

Multi-View Embedding Learning for Incompletely Labeled Data.

Latent Space Model for Higher-order Networks and Generalized Tensor Decomposition

DensE: An Enhanced Non-commutative Representation for Knowledge Graph Embedding with Adaptive Semantic Hierarchy

Deep Manifold Embedding of Attributed Graphs.