Abstract:Optimal Transport (OT) based distances are powerful tools for machine learning to compare probability measures and manipulate them using OT maps. In this field, a setting of interest is semi-discrete OT, where the source measure $\mu$ is continuous, while the target $\nu$ is discrete. Recent works have shown that the minimax rate for the OT map is $\mathcal{O}(t^{-1/2})$ when using $t$ i.i.d. subsamples from each measure (two-sample setting). An open question is whether a better convergence rate can be achieved when the full information of the discrete measure $\nu$ is known (one-sample setting). In this work, we answer positively to this question by (i) proving an $\mathcal{O}(t^{-1})$ lower bound rate for the OT map, using the similarity between Laguerre cells estimation and density support estimation, and (ii) proposing a Stochastic Gradient Descent (SGD) algorithm with adaptive entropic regularization and averaging acceleration. To nearly achieve the desired fast rate, characteristic of non-regular parametric problems, we design an entropic regularization scheme decreasing with the number of samples. Another key step in our algorithm consists of using a projection step that permits to leverage the local strong convexity of the regularized OT problem. Our convergence analysis integrates online convex optimization and stochastic gradient techniques, complemented by the specificities of the OT semi-dual. Moreover, while being as computationally and memory efficient as vanilla SGD, our algorithm achieves the unusual fast rates of our theory in numerical experiments.

Quantitative Stability and Error Estimates for Optimal Transport Plans

Gluing methods for quantitative stability of optimal transport maps

Fast and Accurate Approximations of the Optimal Transport in Semi-Discrete and Discrete Settings

Quantitative stability in optimal transport for general power costs

Quantitative Stability in the Geometry of Semi-discrete Optimal Transport

Semi-discrete unbalanced optimal transport and quantization

Discrete Approximation of Optimal Transport on Compact Spaces

On quantitative stability in infinite-dimensional optimization under uncertainty

Optimal transport between random measures

Approximate Discrete Optimal Transport Plan with Auxiliary Measure Method.

Stability and statistical inference for semidiscrete optimal transport maps

Optimal transport map estimation in general function spaces

Quantitative Stability of the Pushforward Operation by an Optimal Transport Map

Semi-Discrete Optimal Transport: Nearly Minimax Estimation With Stochastic Gradient Descent and Adaptive Entropic Regularization

Convergence Rates of the Regularized Optimal Transport : Disentangling Suboptimality and Entropy

Optimal transport maps, majorization, and log-subharmonic measures

Central Limit Theorems for Smooth Optimal Transport Maps

Full characterization of optimal transport plans for concave costs

Optimal Transport of Linear Systems over Equilibrium Measures

Entropic Approximation of -Optimal Transport Problems

Stochastic optimal transport in Banach Spaces for regularized estimation of multivariate quantiles