Abstract:The need to reason about uncertainty in large, complex, and multi-modal datasets has become increasingly common across modern scientific environments. The ability to transform samples from one distribution $P$ to another distribution $Q$ enables the solution to many problems in machine learning (e.g. Bayesian inference, generative modeling) and has been actively pursued from theoretical, computational, and application perspectives across the fields of information theory, computer science, and biology. Performing such transformations, in general, still leads to computational difficulties, especially in high dimensions. Here, we consider the problem of computing such "measure transport maps" with efficient and parallelizable methods. Under the mild assumptions that $P$ need not be known but can be sampled from, and that the density of $Q$ is known up to a proportionality constant, and that $Q$ is log-concave, we provide in this work a convex optimization problem pertaining to relative entropy minimization. We show how an empirical minimization formulation and polynomial chaos map parameterization can allow for learning a transport map between $P$ and $Q$ with distributed and scalable methods. We also leverage findings from nonequilibrium thermodynamics to represent the transport map as a composition of simpler maps, each of which is learned sequentially with a transport cost regularized version of the aforementioned problem formulation. We provide examples of our framework within the context of Bayesian inference for the Boston housing dataset and generative modeling for handwritten digit images from the MNIST dataset.

Empowering optimal transport matching algorithm for the construction of surrogate parametric metamodel

Semi-Discrete Optimal Transport: Nearly Minimax Estimation With Stochastic Gradient Descent and Adaptive Entropic Regularization

Solving Prior Distribution Mismatch in Diffusion Models via Optimal Transport

A Distributed Framework for the Construction of Transport Maps

Optimal Transport-Based Displacement Interpolation with Data Augmentation for Reduced Order Modeling of Nonlinear Dynamical Systems

Fully Probabilistic Design for Optimal Transport

Base Models for Parabolic Partial Differential Equations

Bridging classical data assimilation and optimal transport: the 3D-Var case

Nonparametric Estimation via Partial Derivatives

Unifying Distributionally Robust Optimization via Optimal Transport Theory

PGD-based advanced nonlinear multiparametric regressions for constructing metamodels at the scarce-data limit

Quantifying Distributional Model Risk via Optimal Transport

Surrogate Modeling for Physical Systems with Preserved Properties and Adjustable Tradeoffs

Progressive Entropic Optimal Transport Solvers

Numerical method for feasible and approximately optimal solutions of multi-marginal optimal transport beyond discrete measures

Functional optimal transport: map estimation and domain adaptation for functional data

Optimal Transportation by Orthogonal Coupling Dynamics

Distributional Uncertainty Propagation via Optimal Transport

Sensitivity analysis using the Metamodel of Optimal Prognosis

Strongly Isomorphic Neural Optimal Transport Across Incomparable Spaces