Abstract:We study the Unbalanced Optimal Transport (UOT) between two measures of possibly different masses with at most $n$ components, where the marginal constraints of standard Optimal Transport (OT) are relaxed via Kullback-Leibler divergence with regularization factor $\tau$. Although only Sinkhorn-based UOT solvers have been analyzed in the literature with the iteration complexity of ${O}\big(\tfrac{\tau \log(n)}{\varepsilon} \log\big(\tfrac{\log(n)}{\varepsilon}\big)\big)$ and per-iteration cost of $O(n^2)$ for achieving the desired error $\varepsilon$, their positively dense output transportation plans strongly hinder the practicality. On the other hand, while being vastly used as heuristics for computing UOT in modern deep learning applications and having shown success in sparse OT problem, gradient methods applied to UOT have not been formally studied. In this paper, we propose a novel algorithm based on Gradient Extrapolation Method (GEM-UOT) to find an $\varepsilon$-approximate solution to the UOT problem in $O\big( \kappa \log\big(\frac{\tau n}{\varepsilon}\big) \big)$ iterations with $\widetilde{O}(n^2)$ per-iteration cost, where $\kappa$ is the condition number depending on only the two input measures. Our proof technique is based on a novel dual formulation of the squared $\ell_2$-norm UOT objective, which fills the lack of sparse UOT literature and also leads to a new characterization of approximation error between UOT and OT. To this end, we further present a novel approach of OT retrieval from UOT, which is based on GEM-UOT with fine tuned $\tau$ and a post-process projection step. Extensive experiments on synthetic and real datasets validate our theories and demonstrate the favorable performance of our methods in practice.

Sparsity of Quadratically Regularized Optimal Transport: Bounds on concentration and bias

Sparsity of Quadratically Regularized Optimal Transport: Scalar Case

Infinitesimal behavior of Quadratically Regularized Optimal Transport and its relation with the Porous Medium Equation

Quadratically Regularized Optimal Transport: Existence and Multiplicity of Potentials

Monotonicity in Quadratically Regularized Linear Programs

Estimation of entropy-regularized optimal transport maps between non-compactly supported measures

Quadratically Regularized Optimal Transport: nearly optimal potentials and convergence of discrete Laplace operators

On Unbalanced Optimal Transport: Gradient Methods, Sparsity and Approximation Error

Quantitative Convergence of Quadratically Regularized Linear Programs

Convergence Rates of the Regularized Optimal Transport : Disentangling Suboptimality and Entropy

Gluing methods for quantitative stability of optimal transport maps

Quantum optimal transport with convex regularization

Sparsistency for Inverse Optimal Transport

On the existence of Monge solutions to multi-marginal optimal transport with quadratic cost and uniform discrete marginals

From Soft-Minoration to Information-Constrained Optimal Transport and Spiked Tensor Models

Low-rank Optimal Transport: Approximation, Statistics and Debiasing

Sparse Estimation Via ℓ_q Optimization Method in High-Dimensional Linear Regression

Approximating Optimal Transport via Low-rank and Sparse Factorization

Efficient and Exact Multimarginal Optimal Transport with Pairwise Costs

Non-commutative Optimal Transport for semi-definite positive matrices