Abstract:Optimal transport (OT) has profoundly impacted machine learning by providing theoretical and computational tools to realign datasets. In this context, given two large point clouds of sizes $n$ and $m$ in $\mathbb{R}^d$, entropic OT (EOT) solvers have emerged as the most reliable tool to either solve the Kantorovich problem and output a $n\times m$ coupling matrix, or to solve the Monge problem and learn a vector-valued push-forward map. While the robustness of EOT couplings/maps makes them a go-to choice in practical applications, EOT solvers remain difficult to tune because of a small but influential set of hyperparameters, notably the omnipresent entropic regularization strength $\varepsilon$. Setting $\varepsilon$ can be difficult, as it simultaneously impacts various performance metrics, such as compute speed, statistical performance, generalization, and bias. In this work, we propose a new class of EOT solvers (ProgOT), that can estimate both plans and transport maps. We take advantage of several opportunities to optimize the computation of EOT solutions by dividing mass displacement using a time discretization, borrowing inspiration from dynamic OT formulations, and conquering each of these steps using EOT with properly scheduled parameters. We provide experimental evidence demonstrating that ProgOT is a faster and more robust alternative to standard solvers when computing couplings at large scales, even outperforming neural network-based approaches. We also prove statistical consistency of our approach for estimating optimal transport maps.

Discrete Probabilistic Inverse Optimal Transport

Sparsistency for Inverse Optimal Transport

Fully Probabilistic Design for Optimal Transport

Learning Cost Functions for Optimal Transport

Unifying Distributionally Robust Optimization via Optimal Transport Theory

Optimal Transport With Relaxed Marginal Constraints

Identifiability of the Optimal Transport Cost on Finite Spaces

Nonlinear Inverse Optimal Transport: Identifiability of the Transport Cost from its Marginals and Optimal Values

Linear Optimal Partial Transport Embedding

Information Bottleneck Revisited: Posterior Probability Perspective with Optimal Transport

Distorted optimal transport

Coupling Matrix Manifolds and Their Applications in Optimal Transport

Optimal Transport for Probabilistic Circuits

Tsallis Regularized Optimal Transport and Ecological Inference

Optimal Transport for Kernel Gaussian Mixture Models

Path constrained unbalanced optimal transport

Decentralized and Equitable Optimal Transport

On Scalable and Efficient Computation of Large Scale Optimal Transport

Optimal Transport on Discrete Domains

Neural Estimation Of Entropic Optimal Transport

Progressive Entropic Optimal Transport Solvers