Abstract:Local Differential Privacy (LDP) can provide each user with strong privacy guarantees under untrusted data curators while ensuring accurate statistics derived from privatized data. Due to its powerfulness, LDP has been widely adopted to protect privacy in various tasks (e.g., heavy hitters discovery, probability estimation) and systems (e.g., Google Chrome, Apple iOS). In particular, <math>(∊,δ)</math>-LDP has been studied in related statistical tasks like private learning and hypothesis testing, but is mainly achieved by using Gaussian mechanism, leading to the limited data utility. In this paper, we investigate several novel mechanisms that achieve <math>(∊,δ)</math>-LDP with higher data utility in collecting and analyzing users' data. Specifically, we first design two <math>(∊,δ)</math>-LDP algorithms for mean estimations on multi-dimensional numeric data, which can ensure higher accuracy than the optimal Gaussian mechanism. Then, we investigate different local protocols for frequency estimations on categorical attributes under <math>(∊,δ)</math>-LDP. Based on the proposed mechanisms, we further study on <math>(∊,δ)</math>-LDP-compliant stochastic gradient descent algorithms for machine learning models. Besides, the theoretical analysis of the error bound and the variance of the proposed algorithms are also presented in the paper. We have conducted extensive experiments on both real-world and synthetic datasets and demonstrated the high data utility of our proposed algorithms in the perspectives of simple data statistics tasks and complex machine learning tasks. The experimental results have shown that our proposed algorithms can effectively improve the data utility in different tasks while alleviating the privacy concerns of each individual.

Fisher Information as a Utility Metric for Frequency Estimation under Local Differential Privacy

Fisher information under local differential privacy

The Right Complexity Measure in Locally Private Estimation: It is Not the Fisher Information.

Utility Analysis and Enhancement of LDP Mechanisms in High-Dimensional Space

Efficient Estimation of a Gaussian Mean with Local Differential Privacy

An Algorithm for Enhancing Privacy-Utility Tradeoff in the Privacy Funnel and Other Lift-based Measures

Utility Aware Optimal Data Selection for Differentially Private Federated Learning in IoV

Efficiency in local differential privacy

Mean Estimation of Numerical Data under (ϵ, Δ)-Utility-optimized Local Differential Privacy

Mean Estimation of Numerical Data Under (ε,δ) -Utility-Optimized Local Differential Privacy

Local Differential Privacy for data collection and analysis

Utility Optimization of Federated Learning with Differential Privacy

A Utility-Optimized Framework for Personalized Private Histogram Estimation

Locally Differentially Private Frequency Estimation with Consistency

Data Privacy and Utility Trade-Off Based on Mutual Information Neural Estimator

A Theoretical Analysis of Efficiency Constrained Utility-Privacy Bi-Objective Optimization in Federated Learning

Local Information Privacy and Its Application to Privacy-Preserving Data Aggregation

On the Statistical Complexity of Estimation and Testing under Privacy Constraints

General Inferential Limits Under Differential and Pufferfish Privacy

On Local Mutual-Information Privacy

AAA: an Adaptive Mechanism for Locally Differential Private Mean Estimation