Abstract:The sliced Wasserstein (SW) distances between two probability measures are defined as the expectation of the Wasserstein distance between two one-dimensional projections of the two measures. The randomness comes from a projecting direction that is used to project the two input measures to one dimension. Due to the intractability of the expectation, Monte Carlo integration is performed to estimate the value of the SW distance. Despite having various variants, there has been no prior work that improves the Monte Carlo estimation scheme for the SW distance in terms of controlling its variance. To bridge the literature on variance reduction and the literature on the SW distance, we propose computationally efficient control variates to reduce the variance of the empirical estimation of the SW distance. The key idea is to first find Gaussian approximations of projected one-dimensional measures, then we utilize the closed-form of the Wasserstein-2 distance between two Gaussian distributions to design the control variates. In particular, we propose using a lower bound and an upper bound of the Wasserstein-2 distance between two fitted Gaussians as two computationally efficient control variates. We empirically show that the proposed control variate estimators can help to reduce the variance considerably when comparing measures over images and point-clouds. Finally, we demonstrate the favorable performance of the proposed control variate estimators in gradient flows to interpolate between two point-clouds and in deep generative modeling on standard image datasets, such as CIFAR10 and CelebA.

Expected $L_2-$discrepancy bound for a class of new stratified sampling models

Discretization Error of Irregular Sampling Approximations of Stochastic Integrals

A class of distortion measures generated from expectile and its estimation

Asymptotic analysis of random partitions ∗

Partitions for stratified sampling

Structure And System Nonprobabilistic Reliability Solution Method Based On Enhanced Optimal Latin Hypercube Sampling

Extensible Grids: Uniform Sampling on a Space-Filling Curve

Mixture discrepancy for quasi-random point sets

On Low Discrepancy Samplings in Product Spaces of Motion Groups

A weighted Discrepancy Bound of quasi-Monte Carlo Importance Sampling

A Generalized L 2 -Discrepancy for Cubature and Uncertainty Quantification of Nonlinear Structures

Adaptive complexity of log-concave sampling

Stochastic Nonlinear Response Analysis of Structures Based on Partition of Probability-assigned Space

Sliced Wasserstein Estimation with Control Variates

Randomized Quasi-Monte Carlo Methods on Triangles: Extensible Lattices and Sequences

Transforming the Challenge of Constructing Low-Discrepancy Point Sets into a Permutation Selection Problem

A Study on Design Uniformity under Errors in the Level Values

Constructing Optimal $L_{\infty}$ Star Discrepancy Sets

Sample Complexity Bounds for Estimating Probability Divergences under Invariances

Sampling scattered data with Bernstein polynomials: stochastic and deterministic error estimates

Sequential good lattice point sets for computer experiments