Abstract:Embedding high-dimensional data into a low-dimensional space is an indispensable component of data analysis. In numerous applications, it is necessary to align and jointly embed multiple datasets from different studies or experimental conditions. Such datasets may share underlying structures of interest but exhibit individual distortions, resulting in misaligned embeddings using traditional techniques. In this work, we propose \textit{Entropic Optimal Transport (EOT) eigenmaps}, a principled approach for aligning and jointly embedding a pair of datasets with theoretical guarantees. Our approach leverages the leading singular vectors of the EOT plan matrix between two datasets to extract their shared underlying structure and align the datasets accordingly in a common embedding space. We interpret our approach as an inter-data variant of the classical Laplacian eigenmaps and diffusion maps embeddings, showing that it enjoys many favorable analogous properties. We then analyze a data-generative model where two observed high-dimensional datasets share latent variables on a common low-dimensional manifold, but each dataset is subject to data-specific translation, scaling, nuisance structures, and noise. We show that in a high-dimensional asymptotic regime, the EOT plan recovers the shared manifold structure by approximating a kernel function evaluated at the locations of the latent variables. Subsequently, we provide a geometric interpretation of our embedding by relating it to the eigenfunctions of population-level operators encoding the density and geometry of the shared manifold. Finally, we showcase the performance of our approach for data integration and embedding through simulations and analyses of real-world biological data, demonstrating its advantages over alternative methods in challenging scenarios.

Entropic Optimal Transport Eigenmaps for Nonlinear Alignment and Joint Embedding of High-Dimensional Datasets

Hierarchical Optimal Transport for Multimodal Distribution Alignment

Progressive Entropic Optimal Transport Solvers

Neural Estimation Of Entropic Optimal Transport

Neural Entropic Gromov-Wasserstein Alignment

Integrating Efficient Optimal Transport and Functional Maps For Unsupervised Shape Correspondence Learning

Entropic Neural Optimal Transport via Diffusion Processes

Kernel spectral joint embeddings for high-dimensional noisy datasets using duo-landmark integral operators

Combining Optimal Transport and Embedding-Based Approaches for More Expressiveness in Unsupervised Graph Alignment

Monge, Bregman and Occam: Interpretable Optimal Transport in High-Dimensions with Feature-Sparse Maps

Scalable Optimal Transport in High Dimensions for Graph Distances, Embedding Alignment, and More

Aligning Embeddings and Geometric Random Graphs: Informational Results and Computational Approaches for the Procrustes-Wasserstein Problem

Scalable Simulation-free Entropic Unbalanced Optimal Transport

Low-dimensional Data Embedding via Robust Ranking

Linear Optimal Partial Transport Embedding

Strongly Isomorphic Neural Optimal Transport Across Incomparable Spaces

Latent Space Optimal Transport for Generative Models

Scalable unsupervised alignment of general metric and non-metric structures

Learning Structured Representations by Embedding Class Hierarchy with Fast Optimal Transport

Unsupervised Iterative Manifold Alignment Via Local Feature Histograms

Feature Robust Optimal Transport for High-dimensional Data