Abstract:We study the Unbalanced Optimal Transport (UOT) between two measures of possibly different masses with at most $n$ components, where the marginal constraints of standard Optimal Transport (OT) are relaxed via Kullback-Leibler divergence with regularization factor $\tau$. Although only Sinkhorn-based UOT solvers have been analyzed in the literature with the iteration complexity of ${O}\big(\tfrac{\tau \log(n)}{\varepsilon} \log\big(\tfrac{\log(n)}{\varepsilon}\big)\big)$ and per-iteration cost of $O(n^2)$ for achieving the desired error $\varepsilon$, their positively dense output transportation plans strongly hinder the practicality. On the other hand, while being vastly used as heuristics for computing UOT in modern deep learning applications and having shown success in sparse OT problem, gradient methods applied to UOT have not been formally studied. In this paper, we propose a novel algorithm based on Gradient Extrapolation Method (GEM-UOT) to find an $\varepsilon$-approximate solution to the UOT problem in $O\big( \kappa \log\big(\frac{\tau n}{\varepsilon}\big) \big)$ iterations with $\widetilde{O}(n^2)$ per-iteration cost, where $\kappa$ is the condition number depending on only the two input measures. Our proof technique is based on a novel dual formulation of the squared $\ell_2$-norm UOT objective, which fills the lack of sparse UOT literature and also leads to a new characterization of approximation error between UOT and OT. To this end, we further present a novel approach of OT retrieval from UOT, which is based on GEM-UOT with fine tuned $\tau$ and a post-process projection step. Extensive experiments on synthetic and real datasets validate our theories and demonstrate the favorable performance of our methods in practice.

A time-fractional optimal transport and mean-field planning: Formulation and algorithm

High order computation of optimal transport, mean field planning, and mean field games

A Quasi-Sequential Algorithm for PDE-constrained Optimization Based on Space–time Orthogonal Collocation on Finite Elements

Accelerating Motion Planning via Optimal Transport

On Scalable and Efficient Computation of Large Scale Optimal Transport

Generalized optimal transport and mean field control problems for reaction-diffusion systems with high-order finite element computation

Coupling Matrix Manifolds and Their Applications in Optimal Transport

Numerical method for feasible and approximately optimal solutions of multi-marginal optimal transport beyond discrete measures

Approximating Optimal Transport via Low-rank and Sparse Factorization

Moment-SoS methods for optimal transport problems

A Neural Network Framework for High-Dimensional Dynamic Unbalanced Optimal Transport

Fully Probabilistic Design for Optimal Transport

Constrained Approximate Optimal Transport Maps

On Unbalanced Optimal Transport: Gradient Methods, Sparsity and Approximation Error

Optimal Transportation by Orthogonal Coupling Dynamics

Progressive Entropic Optimal Transport Solvers

Adaptive Fixed-Time Proximal Gradient Method for Non-Smooth Optimization: the Fractional Approach

Randomized Transport Plans via Hierarchical Fully Probabilistic Design

Anchor Space Optimal Transport as a Fast Solution to Multiple Optimal Transport Problems

An inexact Bregman proximal point method and its acceleration version for unbalanced optimal transport

A Multiscale Semi-Smooth Newton Method for Optimal Transport