A survey of some recent applications of optimal transport methods to econometrics

Alfred Galichon

DOI: https://doi.org/10.48550/arXiv.2102.01716

2021-02-02

General Economics

Abstract:This paper surveys recent applications of methods from the theory of optimal transport to econometric problems.

What problem does this paper attempt to address?

The unreasonable effectiveness of optimal transport in economics

Alfred Galichon

DOI: https://doi.org/10.48550/arXiv.2107.04700

2021-07-09

General Economics

Abstract:Optimal transport has become part of the standard quantitative economics toolbox. It is the framework of choice to describe models of matching with transfers, but beyond that, it allows to: extend quantile regression; identify discrete choice models; provide new algorithms for computing the random coefficient logit model; and generalize the gravity model in trade. This paper offer a brief review of the basics of the theory, its applications to economics, and some extensions.
A survey of Optimal Transport for Computer Graphics and Computer Vision

Nicolas Bonneel,Julie Digne

DOI: https://doi.org/10.1111/cgf.14778

IF: 2.5

2023-05-01

Computer Graphics Forum

Abstract:Optimal transport is a long‐standing theory that has been studied in depth from both theoretical and numerical point of views. Starting from the 50s this theory has also found a lot of applications in operational research. Over the last 30 years it has spread to computer vision and computer graphics and is now becoming hard to ignore. Still, its mathematical complexity can make it difficult to comprehend, and as such, computer vision and computer graphics researchers may find it hard to follow recent developments in their field related to optimal transport. This survey first briefly introduces the theory of optimal transport in layman's terms as well as most common numerical techniques to solve it. More importantly, it presents applications of these numerical techniques to solve various computer graphics and vision related problems. This involves applications ranging from image processing, geometry processing, rendering, fluid simulation, to computational optics, and many more. It is aimed at computer graphics researchers desiring to follow optimal transport research in their field as well as optimal transport researchers willing to find applications for their numerical algorithms.

computer science, software engineering
Recent Advances in Optimal Transport for Machine Learning

Eduardo Fernandes Montesuma,Fred Ngolè Mboula,Antoine Souloumiac

2024-08-21

Abstract:Recently, Optimal Transport has been proposed as a probabilistic framework in Machine Learning for comparing and manipulating probability distributions. This is rooted in its rich history and theory, and has offered new solutions to different problems in machine learning, such as generative modeling and transfer learning. In this survey we explore contributions of Optimal Transport for Machine Learning over the period 2012 -- 2023, focusing on four sub-fields of Machine Learning: supervised, unsupervised, transfer and reinforcement learning. We further highlight the recent development in computational Optimal Transport and its extensions, such as partial, unbalanced, Gromov and Neural Optimal Transport, and its interplay with Machine Learning practice.

Machine Learning,Probability
Scalable Optimal Transport Methods in Machine Learning: A Contemporary Survey

Abdelwahed Khamis,Russell Tsuchida,Mohamed Tarek,Vivien Rolland,Lars Petersson

DOI: https://doi.org/10.1109/tpami.2024.3379571

IF: 23.6

2024-01-01

IEEE Transactions on Pattern Analysis and Machine Intelligence

Abstract:Optimal Transport (OT) is a mathematical framework that first emerged in the eighteenth century and has led to a plethora of methods for answering many theoretical and applied questions. The last decade has been a witness to the remarkable contributions of this classical optimization problem to machine learning. This paper is about where and how optimal transport is used in machine learning with a focus on the question of scalable optimal transport. We provide a comprehensive survey of optimal transport while ensuring an accessible presentation as permitted by the nature of the topic and the context. First, we explain the optimal transport background and introduce different flavors (i.e. mathematical formulations), properties, and notable applications. We then address the fundamental question of how to scale optimal transport to cope with the current demands of big and high dimensional data. We conduct a systematic analysis of the methods used in the literature for scaling OT and present the findings in a unified taxonomy. We conclude with presenting some open challenges and discussing potential future research directions. A live repository of related OT research papers is maintained in https://github.com/abdelwahed/OT_for_big_data.git.

computer science, artificial intelligence,engineering, electrical & electronic
Models and applications of Optimal Transport in Economics, Traffic and Urban Planning

Filippo Santambrogio

DOI: https://doi.org/10.48550/arXiv.1009.3857

2010-09-20

Abstract:Some optimization or equilibrium problems involving somehow the concept of optimal transport are presented in these notes, mainly devoted to applications to economic and game theory settings. A variant model of transport, taking into account traffic congestion effects is the first topic, and it shows various links with Monge-Kantorovich theory and PDEs. Then, two models for urban planning are introduced. The last section is devoted to two problems from economics and their translation in the language of optimal transport.

Classical Analysis and ODEs,Analysis of PDEs,Differential Geometry,Probability
Statistical optimal transport

Sinho Chewi,Jonathan Niles-Weed,Philippe Rigollet

2024-07-26

Abstract:We present an introduction to the field of statistical optimal transport, based on lectures given at École d'Été de Probabilités de Saint-Flour XLIX.

Statistics Theory,Machine Learning
General auction method for real-valued optimal transport

J.D. Walsh III,Luca Dieci

DOI: https://doi.org/10.48550/arXiv.1705.06379

2019-05-02

Abstract:Optimal transportation theory is an area of mathematics with real-world applications in fields ranging from economics to optimal control to machine learning. We propose a new algorithm for solving discrete transport (network flow) problems, based on classical auction methods. Auction methods were originally developed as an alternative to the Hungarian method for the assignment problem, so the classic auction-based algorithms solve integer-valued optimal transport by converting such problems into assignment problems. The general transport auction method we propose works directly on real-valued transport problems. Our results prove termination, bound the transport error, and relate our algorithm to the classic algorithms of Bertsekas and Castanon.

Optimization and Control,Computer Science and Game Theory
On the potential of Optimal Transport in Geospatial Data Science

Nina Wiedemann,Théo Uscidda,Martin Raubal

2024-10-23

Abstract:Prediction problems in geographic information science and transportation are often motivated by the possibility to enhance operational efficiency and thereby reduce emissions. Examples range from predicting car sharing demand for relocation planning to forecasting traffic congestion for navigation purposes. However, conventional accuracy metrics ignore the spatial distribution of the errors, despite its relevance for operations. Here, we put forward a spatially aware evaluation metric and loss function based on Optimal Transport (OT). Our framework leverages partial OT and can minimize relocation costs in any spatial prediction problem. We showcase the advantages of OT-based evaluation over conventional metrics and further demonstrate the application of an OT loss function for improving forecasts of bike sharing demand and charging station occupancy. Thus, our framework not only aligns with operational considerations, but also signifies a step forward in refining predictions within geospatial applications. All code is available at <a class="link-external link-https" href="https://github.com/mie-lab/geospatialOT" rel="external noopener nofollow">this https URL</a>.

Machine Learning,Computational Engineering, Finance, and Science
Optimal Transport Networks in Spatial Equilibrium

Pablo D. Fajgelbaum,Edouard Schaal

DOI: https://doi.org/10.3982/ECTA15213

IF: 6.1

2020-07-23

Econometrica

Abstract:We study optimal transport networks in spatial equilibrium. We develop a framework consisting of a neoclassical trade model with labor mobility in which locations are arranged on a graph. Goods must be shipped through linked locations, and transport costs depend on congestion and on the infrastructure in each link, giving rise to an optimal transport problem in general equilibrium. The optimal transport network is the solution to a social planner's problem of building infrastructure in each link. We provide conditions such that this problem is globally convex, guaranteeing its numerical tractability. We also study cases with increasing returns to transport technologies in which global convexity fails. We apply the framework to assess optimal investments and inefficiencies in the road networks of European countries.

economics,social sciences, mathematical methods,mathematics, interdisciplinary applications,statistics & probability
On optimal transport of matrix-valued measures

Yann Brenier,Dmitry Vorotnikov

DOI: https://doi.org/10.48550/arXiv.1808.05064

2019-07-15

Abstract:We suggest a new way of defining optimal transport of positive-semidefinite matrix-valued measures. It is inspired by a recent rendering of the incompressible Euler equations and related conservative systems as concave maximization problems. The main object of our attention is the Kantorovich-Bures metric space, which is a matricial analogue of the Wasserstein and Hellinger-Kantorovich metric spaces. We establish some topological, metric and geometric properties of this space, which includes the existence of the optimal transportation path.

Optimization and Control,Functional Analysis,Metric Geometry
Convergence of Empirical Optimal Transport in Unbounded Settings

Thomas Staudt,Shayan Hundrieser

2024-07-23

Abstract:In compact settings, the convergence rate of the empirical optimal transport cost to its population value is well understood for a wide class of spaces and cost functions. In unbounded settings, however, hitherto available results require strong assumptions on the ground costs and the concentration of the involved measures. In this work, we pursue a decomposition-based approach to generalize the convergence rates found in compact spaces to unbounded settings under generic moment assumptions that are sharp up to an arbitrarily small $\epsilon > 0$. Hallmark properties of empirical optimal transport on compact spaces, like the recently established adaptation to lower complexity, are shown to carry over to the unbounded case.

Statistics Theory,Probability
A Consistent Extension of Discrete Optimal Transport Maps for Machine Learning Applications

Lucas de Lara,Alberto González-Sanz,Jean-Michel Loubes

DOI: https://doi.org/10.48550/arXiv.2102.08644

2021-02-17

Abstract:Optimal transport maps define a one-to-one correspondence between probability distributions, and as such have grown popular for machine learning applications. However, these maps are generally defined on empirical observations and cannot be generalized to new samples while preserving asymptotic properties. We extend a novel method to learn a consistent estimator of a continuous optimal transport map from two empirical distributions. The consequences of this work are two-fold: first, it enables to extend the transport plan to new observations without computing again the discrete optimal transport map; second, it provides statistical guarantees to machine learning applications of optimal transport. We illustrate the strength of this approach by deriving a consistent framework for transport-based counterfactual explanations in fairness.

Statistics Theory
Applications of optimal transport methods in the least gradient problem

Wojciech Górny

DOI: https://doi.org/10.48550/arXiv.2102.05887

2021-02-11

Abstract:We study the consequences of the equivalence between the least gradient problem and a boundary-to-boundary optimal transport problem in two dimensions. We extend the relationship between the two problems to their respective dual problems, as well as prove several regularity and stability results for the least gradient problem using optimal transport techniques.

Analysis of PDEs,Optimization and Control
A contribution to Optimal Transport on incomparable spaces

Titouan Vayer

DOI: https://doi.org/10.48550/arXiv.2011.04447

2020-11-09

Abstract:Optimal Transport is a theory that allows to define geometrical notions of distance between probability distributions and to find correspondences, relationships, between sets of points. Many machine learning applications are derived from this theory, at the frontier between mathematics and optimization. This thesis proposes to study the complex scenario in which the different data belong to incomparable spaces. In particular we address the following questions: how to define and apply Optimal Transport between graphs, between structured data? How can it be adapted when the data are varied and not embedded in the same metric space? This thesis proposes a set of Optimal Transport tools for these different cases. An important part is notably devoted to the study of the Gromov-Wasserstein distance whose properties allow to define interesting transport problems on incomparable spaces. More broadly, we analyze the mathematical properties of the various proposed tools, we establish algorithmic solutions to compute them and we study their applicability in numerous machine learning scenarii which cover, in particular, classification, simplification, partitioning of structured data, as well as heterogeneous domain adaptation.

Machine Learning
An Optimal Transport Approach for Network Regression

Alex G. Zalles,Kai M. Hung,Ann E. Finneran,Lydia Beaudrot,César A. Uribe

2024-06-18

Abstract:We study the problem of network regression, where one is interested in how the topology of a network changes as a function of Euclidean covariates. We build upon recent developments in generalized regression models on metric spaces based on Fréchet means and propose a network regression method using the Wasserstein metric. We show that when representing graphs as multivariate Gaussian distributions, the network regression problem requires the computation of a Riemannian center of mass (i.e., Fréchet means). Fréchet means with non-negative weights translates into a barycenter problem and can be efficiently computed using fixed point iterations. Although the convergence guarantees of fixed-point iterations for the computation of Wasserstein affine averages remain an open problem, we provide evidence of convergence in a large number of synthetic and real-data scenarios. Extensive numerical results show that the proposed approach improves existing procedures by accurately accounting for graph size, topology, and sparsity in synthetic experiments. Additionally, real-world experiments using the proposed approach result in higher Coefficient of Determination ($R^{2}$) values and lower mean squared prediction error (MSPE), cementing improved prediction capabilities in practice.

Machine Learning,Optimization and Control
A Review on Modern Computational Optimal Transport Methods with Applications in Biomedical Research

Jingyi Zhang,Wenxuan Zhong,Ping Ma

DOI: https://doi.org/10.48550/arXiv.2008.02995

2021-05-20

Abstract:Optimal transport has been one of the most exciting subjects in mathematics, starting from the 18th century. As a powerful tool to transport between two probability measures, optimal transport methods have been reinvigorated nowadays in a remarkable proliferation of modern data science applications. To meet the big data challenges, various computational tools have been developed in the recent decade to accelerate the computation for optimal transport methods. In this review, we present some cutting-edge computational optimal transport methods with a focus on the regularization-based methods and the projection-based methods. We discuss their real-world applications in biomedical research.

Machine Learning
Optimal transport map estimation in general function spaces

Vincent Divol,Jonathan Niles-Weed,Aram-Alexandre Pooladian

2024-01-03

Abstract:We study the problem of estimating a function $T$ given independent samples from a distribution $P$ and from the pushforward distribution $T_\sharp P$. This setting is motivated by applications in the sciences, where $T$ represents the evolution of a physical system over time, and in machine learning, where, for example, $T$ may represent a transformation learned by a deep neural network trained for a generative modeling task. To ensure identifiability, we assume that $T = \nabla \varphi_0$ is the gradient of a convex function, in which case $T$ is known as an \emph{optimal transport map}. Prior work has studied the estimation of $T$ under the assumption that it lies in a Hölder class, but general theory is lacking. We present a unified methodology for obtaining rates of estimation of optimal transport maps in general function spaces. Our assumptions are significantly weaker than those appearing in the literature: we require only that the source measure $P$ satisfy a Poincaré inequality and that the optimal map be the gradient of a smooth convex function that lies in a space whose metric entropy can be controlled. As a special case, we recover known estimation rates for Hölder transport maps, but also obtain nearly sharp results in many settings not covered by prior work. For example, we provide the first statistical rates of estimation when $P$ is the normal distribution and the transport map is given by an infinite-width shallow neural network.

Statistics Theory,Machine Learning
Scaling algorithms for unbalanced optimal transport problems

Lénaïc Chizat,Gabriel Peyré,Bernhard Schmitzer,François-Xavier Vialard

DOI: https://doi.org/10.1090/mcom/3303

IF: 2.118

2018-02-06

Mathematics of Computation

Abstract:This article introduces a new class of fast algorithms to approximate variational problems involving unbalanced optimal transport. While classical optimal transport considers only normalized probability distributions, it is important for many applications to be able to compute some sort of relaxed transportation between arbitrary positive measures. A generic class of such “unbalanced” optimal transport problems has been recently proposed by several authors. In this paper, we show how to extend the now classical entropic regularization scheme to these unbalanced problems. This gives rise to fast, highly parallelizable algorithms that operate by performing only diagonal scaling (i.e., pointwise multiplications) of the transportation couplings. They are generalizations of the celebrated Sinkhorn algorithm. We show how these methods can be used to solve unbalanced transport, unbalanced gradient flows, and to compute unbalanced barycenters. We showcase applications to 2-D shape modification, color transfer, and growth models.

mathematics, applied
A large deviation approach to optimal transport

Christian Léonard

DOI: https://doi.org/10.48550/arXiv.0710.1461

2007-10-08

Probability

Abstract:A probabilistic method for solving the Monge-Kantorovich mass transport problem on $R^d$ is introduced. A system of empirical measures of independent particles is built in such a way that it obeys a doubly indexed large deviation principle with an optimal transport cost as its rate function. As a consequence, new approximation results for the optimal cost function and the optimal transport plans are derived. They follow from the Gamma-convergence of a sequence of normalized relative entropies toward the optimal transport cost. A wide class of cost functions including the standard power cost functions $|x-y|^p$ enter this framework.

A survey of some recent applications of optimal transport methods to econometrics

The unreasonable effectiveness of optimal transport in economics

A survey of Optimal Transport for Computer Graphics and Computer Vision

Recent Advances in Optimal Transport for Machine Learning

Scalable Optimal Transport Methods in Machine Learning: A Contemporary Survey

Models and applications of Optimal Transport in Economics, Traffic and Urban Planning

Statistical optimal transport

General auction method for real-valued optimal transport

On the potential of Optimal Transport in Geospatial Data Science

Optimal Transport Networks in Spatial Equilibrium

On optimal transport of matrix-valued measures

Convergence of Empirical Optimal Transport in Unbounded Settings

A Consistent Extension of Discrete Optimal Transport Maps for Machine Learning Applications

Applications of optimal transport methods in the least gradient problem

A contribution to Optimal Transport on incomparable spaces

An Optimal Transport Approach for Network Regression

A Review on Modern Computational Optimal Transport Methods with Applications in Biomedical Research

Optimal transport map estimation in general function spaces

Scaling algorithms for unbalanced optimal transport problems

A large deviation approach to optimal transport