Abstract:Optimal Transport (OT) based distances are powerful tools for machine learning to compare probability measures and manipulate them using OT maps. In this field, a setting of interest is semi-discrete OT, where the source measure $\mu$ is continuous, while the target $\nu$ is discrete. Recent works have shown that the minimax rate for the OT map is $\mathcal{O}(t^{-1/2})$ when using $t$ i.i.d. subsamples from each measure (two-sample setting). An open question is whether a better convergence rate can be achieved when the full information of the discrete measure $\nu$ is known (one-sample setting). In this work, we answer positively to this question by (i) proving an $\mathcal{O}(t^{-1})$ lower bound rate for the OT map, using the similarity between Laguerre cells estimation and density support estimation, and (ii) proposing a Stochastic Gradient Descent (SGD) algorithm with adaptive entropic regularization and averaging acceleration. To nearly achieve the desired fast rate, characteristic of non-regular parametric problems, we design an entropic regularization scheme decreasing with the number of samples. Another key step in our algorithm consists of using a projection step that permits to leverage the local strong convexity of the regularized OT problem. Our convergence analysis integrates online convex optimization and stochastic gradient techniques, complemented by the specificities of the OT semi-dual. Moreover, while being as computationally and memory efficient as vanilla SGD, our algorithm achieves the unusual fast rates of our theory in numerical experiments.

Stability and statistical inference for semidiscrete optimal transport maps

Statistical Convergence Rates of Optimal Transport Map Estimation between General Distributions

Uniform Confidence Band for Optimal Transport Map on One-Dimensional Data

Limit Theorems for Entropic Optimal Transport Maps and the Sinkhorn Divergence

Central Limit Theorems for Smooth Optimal Transport Maps

Semi-Discrete Optimal Transport: Nearly Minimax Estimation With Stochastic Gradient Descent and Adaptive Entropic Regularization

Approximation rates of entropic maps in semidiscrete optimal transport

Weak limits of entropy regularized Optimal Transport; potentials, plans and divergences

The entropic optimal (self-)transport problem: Limit distributions for decreasing regularization with application to score function estimation

Entropic estimation of optimal transport maps

Path constrained unbalanced optimal transport

Estimation of entropy-regularized optimal transport maps between non-compactly supported measures

Gluing methods for quantitative stability of optimal transport maps

Optimal transport map estimation in general function spaces

A Sinkhorn-type Algorithm for Constrained Optimal Transport

Discrete Probabilistic Inverse Optimal Transport

On the Convergence of Continuous and Discrete Unbalanced Optimal Transport Models for 1-Wasserstein Distance

Quantitative Stability and Error Estimates for Optimal Transport Plans

Neural Estimation Of Entropic Optimal Transport

Examining Entropic Unbalanced Optimal Transport and Sinkhorn Divergences for Spatial Forecast Verification

Approximate Continuous Optimal Transport with Copulas