Abstract:Modelling information from complex systems such as humans social interaction or words co-occurrences in our languages can help to understand how these systems are organized and function. Such systems can be modelled by networks, and network theory provides a useful set of methods to analyze them. Among these methods, graph embedding is a powerful tool to summarize the interactions and topology of a network in a vectorized feature space. When used in input of machine learning algorithms, embedding vectors help with common graph problems such as link prediction, graph matching, etc In Natural Language Processing (NLP), such a vectorization process is also employed. Word embedding has the goal of representing the sense of words, extracting it from large text corpora. Despite differences in the structure of information in input of embedding algorithms, many graph embedding approaches are adapted and inspired from methods in NLP. Limits of these methods are observed in both domains. Most of these methods require long and resource greedy training. Another downside to most methods is that they are black-box , from which understanding how the information is structured is rather complex. Interpretability of a model allows understanding how the vector space is structured without the need for external information, and thus can be audited more easily. With both these limitations in mind, we propose a novel framework to efficiently embed network vertices in an interpretable vector space. Our Lower Dimension Bipartite Framework (LDBGF) leverages the bipartite projection of a network using cliques to reduce dimensionality. Along with LDBGF, we introduce two implementations of this framework that rely on communities instead of cliques: SINr-NR and SINr-MF. We show that SINr-MF can perform well on classical graphs and SINr-NR can produce high-quality graph and word embeddings that are interpretable and stable across runs.

Going Beyond T-SNE: Exposing \texttt{whatlies} in Text Embeddings

Latent Space Cartography: Visual Analysis of Vector Space Embeddings

Text Embeddings Reveal (Almost) As Much As Text

The Language Interpretability Tool: Extensible, Interactive Visualizations and Analysis for NLP Models

Visual Exploration and Comparison of Word Embeddings.

The Geometry of Culture: Analyzing Meaning through Word Embeddings

Dissecting embedding method: learning higher-order structures from data

Tsetlin Machine Embedding: Representing Words Using Logical Expressions

Interpreting Embedding Spaces by Conceptualization

Visual Word2Vec (vis-w2v): Learning Visually Grounded Word Embeddings Using Abstract Scenes

Text comparison using word vector representations and dimensionality reduction

EmbeddingVis: A Visual Analytics Approach to Comparative Network Embedding Inspection

WizMap: Scalable Interactive Visualization for Exploring Large Machine Learning Embeddings

Visualizing Linguistic Diversity of Text Datasets Synthesized by Large Language Models

A Large-Scale Sensitivity Analysis on Latent Embeddings and Dimensionality Reductions for Text Spatializations

Nomic Embed Vision: Expanding the Latent Space

The text-package: An R-package for analyzing and visualizing human language using natural language processing and transformers.

From communities to interpretable network and word embedding: an unified approach

Can GPT embeddings enhance visual exploration of literature datasets? A case study on isostatic pressing research

So Much in So Little: Creating Lightweight Embeddings of Python Libraries

VISIT: Visualizing and Interpreting the Semantic Information Flow of Transformers