Data representation with optimal transport

Rocío Díaz Martín,Ivan V. Medri,Gustavo Kunde Rohde

2024-06-19

Abstract:Optimal transport has been used to define bijective nonlinear transforms and different transport-related metrics for discriminating data and signals. Here we briefly describe the advances in this topic with the main applications and properties in each case.

Optimization and Control

What problem does this paper attempt to address?

Optimal Transport for Manifold-Valued Images

Jan Henrik Fitschen,Friederike Laus,Bernhard Schmitzer

DOI: https://doi.org/10.1007/978-3-319-58771-4_37

2017-01-01

Abstract:We introduce optimal transport-type distances for manifold-valued images. To do so we lift the initial data to measures on the product space of image domain and signal space, where they can then be compared by optimal transport with a transport cost that combines spatial distance and signal discrepancy. Applying recently introduced ‘unbalanced’ optimal transport models leads to more natural results. We illustrate the benefit of the lifting with numerical examples for interpolation of color images and classification of handwritten digits.
On optimal transport of matrix-valued measures

Yann Brenier,Dmitry Vorotnikov

DOI: https://doi.org/10.48550/arXiv.1808.05064

2019-07-15

Abstract:We suggest a new way of defining optimal transport of positive-semidefinite matrix-valued measures. It is inspired by a recent rendering of the incompressible Euler equations and related conservative systems as concave maximization problems. The main object of our attention is the Kantorovich-Bures metric space, which is a matricial analogue of the Wasserstein and Hellinger-Kantorovich metric spaces. We establish some topological, metric and geometric properties of this space, which includes the existence of the optimal transportation path.

Optimization and Control,Functional Analysis,Metric Geometry
Linearized optimal transport on manifolds

Clément Sarrazin,Bernhard Schmitzer

2024-06-06

Abstract:Optimal transport is a geometrically intuitive, robust and flexible metric for sample comparison in data analysis and machine learning. Its formal Riemannian structure allows for a local linearization via a tangent space approximation. This in turn leads to a reduction of computational complexity and simplifies combination with other methods that require a linear structure. Recently this approach has been extended to the unbalanced Hellinger--Kantorovich (HK) distance. In this article we further extend the framework in various ways, including measures on manifolds, the spherical HK distance, a study of the consistency of discretization via the barycentric projection, and the continuity properties of the logarithmic map for the HK distance.

Optimization and Control,Functional Analysis
Functional optimal transport: map estimation and domain adaptation for functional data

Jiacheng Zhu,Aritra Guha,Dat Do,Mengdi Xu,XuanLong Nguyen,Ding Zhao

2023-08-28

Abstract:We introduce a formulation of optimal transport problem for distributions on function spaces, where the stochastic map between functional domains can be partially represented in terms of an (infinite-dimensional) Hilbert-Schmidt operator mapping a Hilbert space of functions to another. For numerous machine learning tasks, data can be naturally viewed as samples drawn from spaces of functions, such as curves and surfaces, in high dimensions. Optimal transport for functional data analysis provides a useful framework of treatment for such domains. { Since probability measures in infinite dimensional spaces generally lack absolute continuity (that is, with respect to non-degenerate Gaussian measures), the Monge map in the standard optimal transport theory for finite dimensional spaces may not exist. Our approach to the optimal transport problem in infinite dimensions is by a suitable regularization technique -- we restrict the class of transport maps to be a Hilbert-Schmidt space of operators.} To this end, we develop an efficient algorithm for finding the stochastic transport map between functional domains and provide theoretical guarantees on the existence, uniqueness, and consistency of our estimate for the Hilbert-Schmidt operator. We validate our method on synthetic datasets and examine the functional properties of the transport map. Experiments on real-world datasets of robot arm trajectories further demonstrate the effectiveness of our method on applications in domain adaptation.

Machine Learning,Applications
A survey of Optimal Transport for Computer Graphics and Computer Vision

Nicolas Bonneel,Julie Digne

DOI: https://doi.org/10.1111/cgf.14778

IF: 2.5

2023-05-01

Computer Graphics Forum

Abstract:Optimal transport is a long‐standing theory that has been studied in depth from both theoretical and numerical point of views. Starting from the 50s this theory has also found a lot of applications in operational research. Over the last 30 years it has spread to computer vision and computer graphics and is now becoming hard to ignore. Still, its mathematical complexity can make it difficult to comprehend, and as such, computer vision and computer graphics researchers may find it hard to follow recent developments in their field related to optimal transport. This survey first briefly introduces the theory of optimal transport in layman's terms as well as most common numerical techniques to solve it. More importantly, it presents applications of these numerical techniques to solve various computer graphics and vision related problems. This involves applications ranging from image processing, geometry processing, rendering, fluid simulation, to computational optics, and many more. It is aimed at computer graphics researchers desiring to follow optimal transport research in their field as well as optimal transport researchers willing to find applications for their numerical algorithms.

computer science, software engineering
Recent Advances in Optimal Transport for Machine Learning

Eduardo Fernandes Montesuma,Fred Ngolè Mboula,Antoine Souloumiac

2024-08-21

Abstract:Recently, Optimal Transport has been proposed as a probabilistic framework in Machine Learning for comparing and manipulating probability distributions. This is rooted in its rich history and theory, and has offered new solutions to different problems in machine learning, such as generative modeling and transfer learning. In this survey we explore contributions of Optimal Transport for Machine Learning over the period 2012 -- 2023, focusing on four sub-fields of Machine Learning: supervised, unsupervised, transfer and reinforcement learning. We further highlight the recent development in computational Optimal Transport and its extensions, such as partial, unbalanced, Gromov and Neural Optimal Transport, and its interplay with Machine Learning practice.

Machine Learning,Probability
Linear Optimal Partial Transport Embedding

Yikun Bai,Ivan Medri,Rocio Diaz Martin,Rana Muhammad Shahroz Khan,Soheil Kolouri

2024-04-24

Abstract:Optimal transport (OT) has gained popularity due to its various applications in fields such as machine learning, statistics, and signal processing. However, the balanced mass requirement limits its performance in practical problems. To address these limitations, variants of the OT problem, including unbalanced OT, Optimal partial transport (OPT), and Hellinger Kantorovich (HK), have been proposed. In this paper, we propose the Linear optimal partial transport (LOPT) embedding, which extends the (local) linearization technique on OT and HK to the OPT problem. The proposed embedding allows for faster computation of OPT distance between pairs of positive measures. Besides our theoretical contributions, we demonstrate the LOPT embedding technique in point-cloud interpolation and PCA analysis.

Machine Learning,Optimization and Control
Optimal Transport on Discrete Domains

Justin Solomon

DOI: https://doi.org/10.48550/arXiv.1801.07745

2018-05-02

Abstract:Inspired by the matching of supply to demand in logistical problems, the optimal transport (or Monge--Kantorovich) problem involves the matching of probability distributions defined over a geometric domain such as a surface or manifold. In its most obvious discretization, optimal transport becomes a large-scale linear program, which typically is infeasible to solve efficiently on triangle meshes, graphs, point clouds, and other domains encountered in graphics and machine learning. Recent breakthroughs in numerical optimal transport, however, enable scalability to orders-of-magnitude larger problems, solvable in a fraction of a second. Here, we discuss advances in numerical optimal transport that leverage understanding of both discrete and smooth aspects of the problem. State-of-the-art techniques in discrete optimal transport combine insight from partial differential equations (PDE) with convex analysis to reformulate, discretize, and optimize transportation problems. The end result is a set of theoretically-justified models suitable for domains with thousands or millions of vertices. Since numerical optimal transport is a relatively new discipline, special emphasis is placed on identifying and explaining open problems in need of mathematical insight and additional research.

Optimization and Control,Artificial Intelligence,Computational Geometry,Numerical Analysis
Computational Optimal Transport and Filtering on Riemannian manifolds

Daniel Grange,Mohammad Al-Jarrah,Ricardo Baptista,Amirhossein Taghvaei,Tryphon T. Georgiou,Sean Phillips,Allen Tannenbaum

2023-10-29

Abstract:In this paper we extend recent developments in computational optimal transport to the setting of Riemannian manifolds. In particular, we show how to learn optimal transport maps from samples that relate probability distributions defined on manifolds. Specializing these maps for sampling conditional probability distributions provides an ensemble approach for solving nonlinear filtering problems defined on such geometries. The proposed computational methodology is illustrated with examples of transport and nonlinear filtering on Lie groups, including the circle $S^1$, the special Euclidean group $SE(2)$, and the special orthogonal group $SO(3)$.

Optimization and Control
Optimal Mass Transport: Signal processing and machine-learning applications

Soheil Kolouri,Serim Park,Matthew Thorpe,Dejan Slepčev,Gustavo K Rohde

DOI: https://doi.org/10.1109/MSP.2017.2695801

Abstract:Transport-based techniques for signal and data analysis have received increased attention recently. Given their ability to provide accurate generative models for signal intensities and other data distributions, they have been used in a variety of applications including content-based retrieval, cancer detection, image super-resolution, and statistical machine learning, to name a few, and shown to produce state of the art results in several applications. Moreover, the geometric characteristics of transport-related metrics have inspired new kinds of algorithms for interpreting the meaning of data distributions. Here we provide a practical overview of the mathematical underpinnings of mass transport-related methods, including numerical implementation, as well as a review, with demonstrations, of several applications. Software accompanying this tutorial is available at [43].
A contribution to Optimal Transport on incomparable spaces

Titouan Vayer

DOI: https://doi.org/10.48550/arXiv.2011.04447

2020-11-09

Abstract:Optimal Transport is a theory that allows to define geometrical notions of distance between probability distributions and to find correspondences, relationships, between sets of points. Many machine learning applications are derived from this theory, at the frontier between mathematics and optimization. This thesis proposes to study the complex scenario in which the different data belong to incomparable spaces. In particular we address the following questions: how to define and apply Optimal Transport between graphs, between structured data? How can it be adapted when the data are varied and not embedded in the same metric space? This thesis proposes a set of Optimal Transport tools for these different cases. An important part is notably devoted to the study of the Gromov-Wasserstein distance whose properties allow to define interesting transport problems on incomparable spaces. More broadly, we analyze the mathematical properties of the various proposed tools, we establish algorithmic solutions to compute them and we study their applicability in numerous machine learning scenarii which cover, in particular, classification, simplification, partitioning of structured data, as well as heterogeneous domain adaptation.

Machine Learning
Relative Optimal Transport

Peter Bubenik,Alex Elchesen

2024-11-09

Abstract:We develop a theory of optimal transport relative to a distinguished subset, which acts as a reservoir of mass, allowing us to compare measures of different total variation. This relative transportation problem has an optimal solution and we obtain relative versions of the Kantorovich-Rubinstein norm, Wasserstein distance, Kantorovich-Rubinstein duality and Monge-Kantorovich duality. We also prove relative versions of the Riesz-Markov-Kakutani theorem, which connect the spaces of measures arising from the relative optimal transport problem to spaces of Lipschitz functions.

Metric Geometry,Algebraic Topology,Functional Analysis,Optimization and Control,Probability
Nonlinear Inverse Optimal Transport: Identifiability of the Transport Cost from its Marginals and Optimal Values

Alberto González-Sanz,Michel Groppe,Axel Munk

2024-06-20

Abstract:The inverse optimal transport problem is to find the underlying cost function from the knowledge of optimal transport plans. While this amounts to solving a linear inverse problem, in this work we will be concerned with the nonlinear inverse problem to identify the cost function when only a set of marginals and its corresponding optimal values are given. We focus on absolutely continuous probability distributions with respect to the $d$-dimensional Lebesgue measure and classes of concave and convex cost functions. Our main result implies that the cost function is uniquely determined from the union of the ranges of the gradients of the optimal potentials. Since, in general, the optimal potentials may not be observed, we derive sufficient conditions for their identifiability - if an open set of marginals is observed, the optimal potentials are then identified via the value of the optimal costs. We conclude with a more in-depth study of this problem in the univariate case, where an explicit representation of the transport plan is available. Here, we link the notion of identifiability of the cost function with that of statistical completeness.

Optimization and Control
Optimal Transport for Applied Mathematicians

Filippo Santambrogio

DOI: https://doi.org/10.1007/978-3-319-20828-2

2015-01-01

Abstract:This monograph presents a rigorous mathematical introduction to optimal transport as a variational problem, its use in modeling various phenomena, and its connections with partial differential equations. Its main goal is to provide the reader with the techniques necessary to understand the current research in optimal transport and the tools which are most useful for its applications. Full proofs are used to illustrate mathematical concepts and each chapter includes a section that discusses applications of optimal transport to various areas, such as economics, finance, potential games, image processing and fluid dynamics. Several topics are covered that have never been previously in books on this subject, such as the Knothe transport, the properties of functionals on measures, the Dacorogna-Moser flow, the formulation through minimal flows with prescribed divergence formulation, the case of the supremal cost, and the most classical numerical methods. Graduate students and researchers in both pure and applied mathematics interested in the problems and applications of optimal transport will find this to be an invaluable resource.
Riemannian Metric Learning via Optimal Transport

Christopher Scarvelis,Justin Solomon

DOI: https://doi.org/10.48550/arXiv.2205.09244

2023-03-07

Abstract:We introduce an optimal transport-based model for learning a metric tensor from cross-sectional samples of evolving probability measures on a common Riemannian manifold. We neurally parametrize the metric as a spatially-varying matrix field and efficiently optimize our model's objective using a simple alternating scheme. Using this learned metric, we can nonlinearly interpolate between probability measures and compute geodesics on the manifold. We show that metrics learned using our method improve the quality of trajectory inference on scRNA and bird migration data at the cost of little additional cross-sectional data.

Machine Learning
Optimal transport map estimation in general function spaces

Vincent Divol,Jonathan Niles-Weed,Aram-Alexandre Pooladian

2024-01-03

Abstract:We study the problem of estimating a function $T$ given independent samples from a distribution $P$ and from the pushforward distribution $T_\sharp P$. This setting is motivated by applications in the sciences, where $T$ represents the evolution of a physical system over time, and in machine learning, where, for example, $T$ may represent a transformation learned by a deep neural network trained for a generative modeling task. To ensure identifiability, we assume that $T = \nabla \varphi_0$ is the gradient of a convex function, in which case $T$ is known as an \emph{optimal transport map}. Prior work has studied the estimation of $T$ under the assumption that it lies in a Hölder class, but general theory is lacking. We present a unified methodology for obtaining rates of estimation of optimal transport maps in general function spaces. Our assumptions are significantly weaker than those appearing in the literature: we require only that the source measure $P$ satisfy a Poincaré inequality and that the optimal map be the gradient of a smooth convex function that lies in a space whose metric entropy can be controlled. As a special case, we recover known estimation rates for Hölder transport maps, but also obtain nearly sharp results in many settings not covered by prior work. For example, we provide the first statistical rates of estimation when $P$ is the normal distribution and the transport map is given by an infinite-width shallow neural network.

Statistics Theory,Machine Learning
Statistical optimal transport

Sinho Chewi,Jonathan Niles-Weed,Philippe Rigollet

2024-07-26

Abstract:We present an introduction to the field of statistical optimal transport, based on lectures given at École d'Été de Probabilités de Saint-Flour XLIX.

Statistics Theory,Machine Learning
Simple Unbalanced Optimal Transport

Boris Khesin,Klas Modin,Luke Volk

DOI: https://doi.org/10.1093/imrn/rnae020

2024-02-23

International Mathematics Research Notices

Abstract:Abstract We introduce and study a simple model capturing the main features of unbalanced optimal transport. It is based on equipping the conical extension of the group of all diffeomorphisms with a natural metric, which allows a Riemannian submersion to the space of volume forms of arbitrary total mass. We describe its finite-dimensional version and present a concise comparison study of the geometry, Hamiltonian features, and geodesics for this and other extensions. One of the corollaries of this approach is that along any geodesic the total mass evolves with constant acceleration, as an object’s height in a constant buoyancy field.

mathematics
Fast Algorithms for a New Relaxation of Optimal Transport

Moses Charikar,Beidi Chen,Christopher Re,Erik Waingarten

2023-07-14

Abstract:We introduce a new class of objectives for optimal transport computations of datasets in high-dimensional Euclidean spaces. The new objectives are parametrized by $\rho \geq 1$, and provide a metric space $\mathcal{R}_{\rho}(\cdot, \cdot)$ for discrete probability distributions in $\mathbb{R}^d$. As $\rho$ approaches $1$, the metric approaches the Earth Mover's distance, but for $\rho$ larger than (but close to) $1$, admits significantly faster algorithms. Namely, for distributions $\mu$ and $\nu$ supported on $n$ and $m$ vectors in $\mathbb{R}^d$ of norm at most $r$ and any $\epsilon > 0$, we give an algorithm which outputs an additive $\epsilon r$-approximation to $\mathcal{R}_{\rho}(\mu, \nu)$ in time $(n+m) \cdot \mathrm{poly}((nm)^{(\rho-1)/\rho} \cdot 2^{\rho / (\rho-1)} / \epsilon)$.

Data Structures and Algorithms
Tsallis Regularized Optimal Transport and Ecological Inference

Boris Muzellec,Richard Nock,Giorgio Patrini,Frank Nielsen

DOI: https://doi.org/10.1609/aaai.v31i1.10854

2017-02-13

Proceedings of the AAAI Conference on Artificial Intelligence

Abstract:Optimal transport is a powerful framework for computing distances between probability distributions. We unify the two main approaches to optimal transport, namely Monge-Kantorovitch and Sinkhorn-Cuturi, into what we define as Tsallis regularized optimal transport (TROT). TROT interpolates a rich family of distortions from Wasserstein to Kullback-Leibler, encompassing as well Pearson, Neyman and Hellinger divergences, to name a few. We show that metric properties known for Sinkhorn-Cuturi generalize to TROT, and provide efficient algorithms for finding the optimal transportation plan with formal convergence proofs. We also present the first application of optimal transport to the problem of ecological inference, that is, the reconstruction of joint distributions from their marginals, a problem of large interest in the social sciences. TROT provides a convenient framework for ecological inference by allowing to compute the joint distribution -— that is, the optimal transportation plan itself — when side information is available, which is e.g. typically what census represents in political science. Experiments on data from the 2012 US presidential elections display the potential of TROT in delivering a faithful reconstruction of the joint distribution of ethnic groups and voter preferences.

Data representation with optimal transport

Optimal Transport for Manifold-Valued Images

On optimal transport of matrix-valued measures

Linearized optimal transport on manifolds

Functional optimal transport: map estimation and domain adaptation for functional data

A survey of Optimal Transport for Computer Graphics and Computer Vision

Recent Advances in Optimal Transport for Machine Learning

Linear Optimal Partial Transport Embedding

Optimal Transport on Discrete Domains

Computational Optimal Transport and Filtering on Riemannian manifolds

Optimal Mass Transport: Signal processing and machine-learning applications

A contribution to Optimal Transport on incomparable spaces

Relative Optimal Transport

Nonlinear Inverse Optimal Transport: Identifiability of the Transport Cost from its Marginals and Optimal Values

Optimal Transport for Applied Mathematicians

Riemannian Metric Learning via Optimal Transport

Optimal transport map estimation in general function spaces

Statistical optimal transport

Simple Unbalanced Optimal Transport

Fast Algorithms for a New Relaxation of Optimal Transport

Tsallis Regularized Optimal Transport and Ecological Inference