Abstract:Modelling information from complex systems such as humans social interaction or words co-occurrences in our languages can help to understand how these systems are organized and function. Such systems can be modelled by networks, and network theory provides a useful set of methods to analyze them. Among these methods, graph embedding is a powerful tool to summarize the interactions and topology of a network in a vectorized feature space. When used in input of machine learning algorithms, embedding vectors help with common graph problems such as link prediction, graph matching, etc In Natural Language Processing (NLP), such a vectorization process is also employed. Word embedding has the goal of representing the sense of words, extracting it from large text corpora. Despite differences in the structure of information in input of embedding algorithms, many graph embedding approaches are adapted and inspired from methods in NLP. Limits of these methods are observed in both domains. Most of these methods require long and resource greedy training. Another downside to most methods is that they are black-box , from which understanding how the information is structured is rather complex. Interpretability of a model allows understanding how the vector space is structured without the need for external information, and thus can be audited more easily. With both these limitations in mind, we propose a novel framework to efficiently embed network vertices in an interpretable vector space. Our Lower Dimension Bipartite Framework (LDBGF) leverages the bipartite projection of a network using cliques to reduce dimensionality. Along with LDBGF, we introduce two implementations of this framework that rely on communities instead of cliques: SINr-NR and SINr-MF. We show that SINr-MF can perform well on classical graphs and SINr-NR can produce high-quality graph and word embeddings that are interpretable and stable across runs.

JEFL: Joint Embedding of Formal Proof Libraries

Bridging the Semantic Latent Space Between Brain and Machine: Similarity is All You Need

Discovering emergent connections in quantum physics research via dynamic word embeddings

Fast Extraction of Word Embedding from Q-contexts

An Exploration Of Semantic Relations In Neural Word Embeddings Using Extrinsic Knowledge

Neural-Symbolic Entangled Framework for Complex Query Answering

Verifying Programs with Logic and Extended Proof Rules: Deep Embedding v.s. Shallow Embedding

Premise Selection for Theorem Proving by Deep Graph Embedding

Improving Graph Neural Network Representations of Logical Formulae with Subgraph Pooling

Interpreting Embedding Spaces by Conceptualization

Combining Fact Extraction and Verification with Neural Semantic Matching Networks

From communities to interpretable network and word embedding: an unified approach

Vicept: link visual features to concepts for large-scale image understanding.

GRAFS: Graphical Faceted Search System to Support Conceptual Understanding in Exploratory Search

A Concept-Based Explainability Framework for Large Multimodal Models

Probabilistic Belief Embedding for Large-Scale Knowledge Population

CheckEmbed: Effective Verification of LLM Solutions to Open-Ended Tasks

ProjE: Embedding Projection for Knowledge Graph Completion

Combing Context and Commonsense Knowledge Through Neural Networks for Solving Winograd Schema Problems.

Interactive Search and Exploration in Online Discussion Forums Using Multimodal Embeddings

Semantic Enhanced Text-to-SQL Parsing Via Iteratively Learning Schema Linking Graph