Abstract:We investigate unbiased high-dimensional mean estimators in differential privacy. We consider differentially private mechanisms whose expected output equals the mean of the input dataset, for every dataset drawn from a fixed bounded $d$-dimensional domain $K$. A classical approach to private mean estimation is to compute the true mean and add unbiased, but possibly correlated, Gaussian noise to it. In the first part of this paper, we study the optimal error achievable by a Gaussian noise mechanism for a given domain $K$ when the error is measured in the $\ell_p$ norm for some $p \ge 2$. We give algorithms that compute the optimal covariance for the Gaussian noise for a given $K$ under suitable assumptions, and prove a number of nice geometric properties of the optimal error. These results generalize the theory of factorization mechanisms from domains $K$ that are symmetric and finite (or, equivalently, symmetric polytopes) to arbitrary bounded domains. In the second part of the paper we show that Gaussian noise mechanisms achieve nearly optimal error among all private unbiased mean estimation mechanisms in a very strong sense. In particular, for every input dataset, an unbiased mean estimator satisfying concentrated differential privacy introduces approximately at least as much error as the best Gaussian noise mechanism. We extend this result to local differential privacy, and to approximate differential privacy, but for the latter the error lower bound holds either for a dataset or for a neighboring dataset, and this relaxation is necessary.

Instance-optimal Mean Estimation Under Differential Privacy

Mean Estimation Under Heterogeneous Privacy Demands

Mean Estimation Under Heterogeneous Privacy: Some Privacy Can Be Free

Mean estimation in the add-remove model of differential privacy

Instance-Optimal Differentially Private Estimation

Minimax Rates of Estimating Approximate Differential Privacy

Mean Estimation of Numerical Data Under (ε,δ) -Utility-Optimized Local Differential Privacy

The Cost of Privacy: Optimal Rates of Convergence for Parameter Estimation with Differential Privacy

A Huber Loss Minimization Approach to Mean Estimation under User-level Differential Privacy

Private Mean Estimation with Person-Level Differential Privacy

Mean Estimation of Numerical Data under (ϵ, Δ)-Utility-optimized Local Differential Privacy

AAA: an Adaptive Mechanism for Locally Differential Private Mean Estimation

General Gaussian Noise Mechanisms and Their Optimality for Unbiased Mean Estimation

Efficient Estimation of a Gaussian Mean with Local Differential Privacy

Robust and Differentially Private Mean Estimation

Average-Case Averages: Private Algorithms for Smooth Sensitivity and Mean Estimation

Differentially-Private Collaborative Online Personalized Mean Estimation

The optimal mechanism in differential privacy

Empirical Mean and Frequency Estimation Under Heterogeneous Privacy: A Worst-Case Analysis

Optimal and Differentially Private Data Acquisition: Central and Local Mechanisms