Abstract:Local Differential Privacy (LDP) can provide each user with strong privacy guarantees under untrusted data curators while ensuring accurate statistics derived from privatized data. Due to its powerfulness, LDP has been widely adopted to protect privacy in various tasks (e.g., heavy hitters discovery, probability estimation) and systems (e.g., Google Chrome, Apple iOS). In particular, <math>(∊,δ)</math>-LDP has been studied in related statistical tasks like private learning and hypothesis testing, but is mainly achieved by using Gaussian mechanism, leading to the limited data utility. In this paper, we investigate several novel mechanisms that achieve <math>(∊,δ)</math>-LDP with higher data utility in collecting and analyzing users' data. Specifically, we first design two <math>(∊,δ)</math>-LDP algorithms for mean estimations on multi-dimensional numeric data, which can ensure higher accuracy than the optimal Gaussian mechanism. Then, we investigate different local protocols for frequency estimations on categorical attributes under <math>(∊,δ)</math>-LDP. Based on the proposed mechanisms, we further study on <math>(∊,δ)</math>-LDP-compliant stochastic gradient descent algorithms for machine learning models. Besides, the theoretical analysis of the error bound and the variance of the proposed algorithms are also presented in the paper. We have conducted extensive experiments on both real-world and synthetic datasets and demonstrated the high data utility of our proposed algorithms in the perspectives of simple data statistics tasks and complex machine learning tasks. The experimental results have shown that our proposed algorithms can effectively improve the data utility in different tasks while alleviating the privacy concerns of each individual.

A Simple Linear Space Data Structure for ANN with Application in Differential Privacy

Differentially Private Numerical Vector Analyses in the Local and Shuffle Model

Differentially Private Simple Linear Regression

Differential Privacy on Finite Computers

Local Differential Privacy for data collection and analysis

Statistical Quantification of Differential Privacy: A Local Approach

The Normal Distributions Indistinguishability Spectrum and its Application to Privacy-Preserving Machine Learning

Improved Space-Efficient Approximate Nearest Neighbor Search Using Function Inversion

Optimizing Noise for $f$-Differential Privacy via Anti-Concentration and Stochastic Dominance

A Comprehensive Survey on Local Differential Privacy toward Data Statistics and Analysis

SRS: solving c-approximate nearest neighbor queries in high dimensional euclidean space with a tiny index

The Flajolet-Martin Sketch Itself Preserves Differential Privacy: Private Counting with Minimal Space

Optimal Locally Private Data Stream Analytics

Differentially Private Spatial Decompositions

Privacy for Fairness: Information Obfuscation for Fair Representation Learning with Local Differential Privacy

Almost Tight Error Bounds on Differentially Private Continual Counting

Pure Differential Privacy for Functional Summaries via a Laplace-like Process

A Systematic and Formal Study of the Impact of Local Differential Privacy on Fairness: Preliminary Results

Inferential Privacy Guarantees for Differentially Private Mechanisms

Minimax Optimal Two-Sample Testing under Local Differential Privacy

The Cost of Privacy: Optimal Rates of Convergence for Parameter Estimation with Differential Privacy