Abstract:Optimal Transport (OT) based distances are powerful tools for machine learning to compare probability measures and manipulate them using OT maps. In this field, a setting of interest is semi-discrete OT, where the source measure $\mu$ is continuous, while the target $\nu$ is discrete. Recent works have shown that the minimax rate for the OT map is $\mathcal{O}(t^{-1/2})$ when using $t$ i.i.d. subsamples from each measure (two-sample setting). An open question is whether a better convergence rate can be achieved when the full information of the discrete measure $\nu$ is known (one-sample setting). In this work, we answer positively to this question by (i) proving an $\mathcal{O}(t^{-1})$ lower bound rate for the OT map, using the similarity between Laguerre cells estimation and density support estimation, and (ii) proposing a Stochastic Gradient Descent (SGD) algorithm with adaptive entropic regularization and averaging acceleration. To nearly achieve the desired fast rate, characteristic of non-regular parametric problems, we design an entropic regularization scheme decreasing with the number of samples. Another key step in our algorithm consists of using a projection step that permits to leverage the local strong convexity of the regularized OT problem. Our convergence analysis integrates online convex optimization and stochastic gradient techniques, complemented by the specificities of the OT semi-dual. Moreover, while being as computationally and memory efficient as vanilla SGD, our algorithm achieves the unusual fast rates of our theory in numerical experiments.

Local Asymptotic Minimax Estimation of Nonregular Parameters with Translation-Scale Equivariant Maps

Local Linear M‐estimation in Non‐parametric Spatial Regression

Local convergence rates of the nonparametric least squares estimator with applications to transfer learning

Two New Families of Local Asymptotically Minimax Lower Bounds in Parameter Estimation

Second-Order Characterization of Minimax Parameter Estimation in Restricted Parameter Space

Asymptotic Optimality in Stochastic Optimization

Local Asymptotics for some Stochastic Optimization Problems: Optimality, Constraint Identification, and Dual Averaging

Generalized van Trees inequality: Local minimax bounds for non-smooth functionals and irregular statistical models

Characterizing the minimax rate of nonparametric regression under bounded convex constraints

Local Learning Estimates by Integral Operators.

An Alternative Regularization Method for Nonexpansive Mappings with Applications

Noisy recovery from random linear observations: Sharp minimax rates under elliptical constraints

Semi-Discrete Optimal Transport: Nearly Minimax Estimation With Stochastic Gradient Descent and Adaptive Entropic Regularization

Local Linear-Additive Estimation for Multiple Nonparametric Regressions.

Minimax rates of convergence for nonparametric location-scale models

ε-Stability of Estimation for a Class of Equivariant Estimators (ξ)1 of the Scale Parameter

Adaptive and non-adaptive minimax rates for weighted Laplacian-eigenmap based nonparametric regression

Optimal and Superoptimal Convergence Rate of the Local Linear Estimator of Nonparametric Regression Function in Continuous Time

Asymptotics for change-point models under varying degrees of mis-specification

Precise Error Analysis of Regularized M-estimators in High-dimensions

Estimation in the convolution structure density model. Part II: adaptation over the scale of anisotropic classes