Abstract:Estimating the density of a distribution from samples is a fundamental problem in statistics. In many practical settings, the Wasserstein distance is an appropriate error metric for density estimation. For example, when estimating population densities in a geographic region, a small Wasserstein distance means that the estimate is able to capture roughly where the population mass is. In this work we study differentially private density estimation in the Wasserstein distance. We design and analyze instance-optimal algorithms for this problem that can adapt to easy instances. For distributions $P$ over $\mathbb{R}$, we consider a strong notion of instance-optimality: an algorithm that uniformly achieves the instance-optimal estimation rate is competitive with an algorithm that is told that the distribution is either $P$ or $Q_P$ for some distribution $Q_P$ whose probability density function (pdf) is within a factor of 2 of the pdf of $P$. For distributions over $\mathbb{R}^2$, we use a different notion of instance optimality. We say that an algorithm is instance-optimal if it is competitive with an algorithm that is given a constant-factor multiplicative approximation of the density of the distribution. We characterize the instance-optimal estimation rates in both these settings and show that they are uniformly achievable (up to polylogarithmic factors). Our approach for $\mathbb{R}^2$ extends to arbitrary metric spaces as it goes via hierarchically separated trees. As a special case our results lead to instance-optimal private learning in TV distance for discrete distributions.

Distribution Function Estimates by Wasserstein Metric and Bernstein Approximation for C −1 Functions

On Bernstein Type Inequalities for Stochastic Integrals of Multivariate Point Processes

Nonparametric Statistical Inference via Metric Distribution Function in Metric Spaces

Estimation of the distribution and density functions using Bernstein polynomials under weak dependence

Bernstein approximation and beyond: proofs by means of elementary probability theory

A Proof of the Central Limit Theorem Using the $2$-Wasserstein Metric

Central limit theorem for the Sliced 1-Wasserstein distance and the max-Sliced 1-Wasserstein distance

Uniform Approximation by Polynomials with Integer Coefficients via the Bernstein Lattice

Causal effects based on distributional distances

Instance-Optimal Private Density Estimation in the Wasserstein Distance

Confidence regions in Wasserstein distributionally robust estimation

Memory Efficient And Minimax Distribution Estimation Under Wasserstein Distance Using Bayesian Histograms

Inference for Projection-Based Wasserstein Distances on Finite Spaces

On the Wasserstein Median of Probability Measures

Minimum Hellinger-Type Distance Estimation for Censored-Data

Nonparametric Estimation and Comparison of Distance Distributions from Censored Data

Wasserstein-p Bounds in the Central Limit Theorem Under Local Dependence

Robust Estimation under the Wasserstein Distance

Bounding Wasserstein distance with couplings

Hierarchical Integral Probability Metrics: A distance on random probability measures with low sample complexity

Empirical Likelihood Confidence Intervals for Hazard and Density Functions under Right Censorship