Abstract:Embedding high-dimensional data into a low-dimensional space is an indispensable component of data analysis. In numerous applications, it is necessary to align and jointly embed multiple datasets from different studies or experimental conditions. Such datasets may share underlying structures of interest but exhibit individual distortions, resulting in misaligned embeddings using traditional techniques. In this work, we propose \textit{Entropic Optimal Transport (EOT) eigenmaps}, a principled approach for aligning and jointly embedding a pair of datasets with theoretical guarantees. Our approach leverages the leading singular vectors of the EOT plan matrix between two datasets to extract their shared underlying structure and align the datasets accordingly in a common embedding space. We interpret our approach as an inter-data variant of the classical Laplacian eigenmaps and diffusion maps embeddings, showing that it enjoys many favorable analogous properties. We then analyze a data-generative model where two observed high-dimensional datasets share latent variables on a common low-dimensional manifold, but each dataset is subject to data-specific translation, scaling, nuisance structures, and noise. We show that in a high-dimensional asymptotic regime, the EOT plan recovers the shared manifold structure by approximating a kernel function evaluated at the locations of the latent variables. Subsequently, we provide a geometric interpretation of our embedding by relating it to the eigenfunctions of population-level operators encoding the density and geometry of the shared manifold. Finally, we showcase the performance of our approach for data integration and embedding through simulations and analyses of real-world biological data, demonstrating its advantages over alternative methods in challenging scenarios.

An Interpretable Data Embedding under Uncertain Distance Information.

Interpretable Embedding and Visualization of Compressed Data

FIDE: Fast and Interpretable 2D Embedding with Correlation, Distance, and Rank Considerations.

Low-dimensional Data Embedding via Robust Ranking

Estimation of embedding vectors in high dimensions

Distance Metric Learning from Uncertain Side Information with Application to Automated Photo Tagging

Subspace Embeddings Under Nonlinear Transformations

Sailing in high-dimensional spaces: Low-dimensional embeddings through angle preservation

On Probabilistic Embeddings in Optimal Dimension Reduction

Wasserstein Wormhole: Scalable Optimal Transport Distance with Transformers

A Computational Approach to Interpreting the Embedding Space of Dimension Reduction

2D Embeddings of Multi-dimensional Partitionings

See without looking: joint visualization of sensitive multi-site datasets

Asymmetric Transitivity Preserving Graph Embedding

Hyperbolic Distance Matrices

Entropic Optimal Transport Eigenmaps for Nonlinear Alignment and Joint Embedding of High-Dimensional Datasets

Measuring What Matters: Intrinsic Distance Preservation as a Robust Metric for Embedding Quality

Assessing and improving reliability of neighbor embedding methods: a map-continuity perspective

Representation Tradeoffs for Hyperbolic Embeddings

Deep Variational Network Embedding in Wasserstein Space