Abstract:Local Differential Privacy (LDP) can provide each user with strong privacy guarantees under untrusted data curators while ensuring accurate statistics derived from privatized data. Due to its powerfulness, LDP has been widely adopted to protect privacy in various tasks (e.g., heavy hitters discovery, probability estimation) and systems (e.g., Google Chrome, Apple iOS). In particular, <math>(∊,δ)</math>-LDP has been studied in related statistical tasks like private learning and hypothesis testing, but is mainly achieved by using Gaussian mechanism, leading to the limited data utility. In this paper, we investigate several novel mechanisms that achieve <math>(∊,δ)</math>-LDP with higher data utility in collecting and analyzing users' data. Specifically, we first design two <math>(∊,δ)</math>-LDP algorithms for mean estimations on multi-dimensional numeric data, which can ensure higher accuracy than the optimal Gaussian mechanism. Then, we investigate different local protocols for frequency estimations on categorical attributes under <math>(∊,δ)</math>-LDP. Based on the proposed mechanisms, we further study on <math>(∊,δ)</math>-LDP-compliant stochastic gradient descent algorithms for machine learning models. Besides, the theoretical analysis of the error bound and the variance of the proposed algorithms are also presented in the paper. We have conducted extensive experiments on both real-world and synthetic datasets and demonstrated the high data utility of our proposed algorithms in the perspectives of simple data statistics tasks and complex machine learning tasks. The experimental results have shown that our proposed algorithms can effectively improve the data utility in different tasks while alleviating the privacy concerns of each individual.

Fast searching optimal negative surveys

Estimating Positive Surveys from Negative Surveys

On the dependable level of the negative survey

Enhancing the Privacy of Negative Surveys Using Negative Combined Categories

On the Reconstruction Method for Negative Surveys with Application to Education Surveys.

Reconstructing Positive Surveys From Negative Surveys With Background Knowledge

User Multi-behavior Enhanced POI Recommendation with Efficient and Informative Negative Sampling.

On Consistency in Multiquestion Negative Surveys with Application to Healthcare Data Collection.

Negative Sampling in Recommendation: A Survey and Future Directions

On Location and Trace Privacy of the Moving Object Using the Negative Survey

PSO-Optimized Negative Selection Algorithm for Anomaly Detection

A Privacy-Preserving Aggregation Scheme Based on Immunological Negative Surveys for Smart Meters

ABNS: Association-based negative sampling for collaborative filtering

Local Differential Privacy for data collection and analysis

SvdNPD: a negative data publication method based on the sensitive value distribution

Adaptive Hardness Negative Sampling for Collaborative Filtering

Privacy-Preserving Distributed Optimization and Learning

A Novel Negative Location Collection Method for Finding Aggregated Locations

Augmented Negative Sampling for Collaborative Filtering

Optimizing Top-N Collaborative Filtering Via Dynamic Negative Item Sampling

Instance-optimal Mean Estimation Under Differential Privacy