Abstract:Local Differential Privacy (LDP) can provide each user with strong privacy guarantees under untrusted data curators while ensuring accurate statistics derived from privatized data. Due to its powerfulness, LDP has been widely adopted to protect privacy in various tasks (e.g., heavy hitters discovery, probability estimation) and systems (e.g., Google Chrome, Apple iOS). In particular, <math>(∊,δ)</math>-LDP has been studied in related statistical tasks like private learning and hypothesis testing, but is mainly achieved by using Gaussian mechanism, leading to the limited data utility. In this paper, we investigate several novel mechanisms that achieve <math>(∊,δ)</math>-LDP with higher data utility in collecting and analyzing users' data. Specifically, we first design two <math>(∊,δ)</math>-LDP algorithms for mean estimations on multi-dimensional numeric data, which can ensure higher accuracy than the optimal Gaussian mechanism. Then, we investigate different local protocols for frequency estimations on categorical attributes under <math>(∊,δ)</math>-LDP. Based on the proposed mechanisms, we further study on <math>(∊,δ)</math>-LDP-compliant stochastic gradient descent algorithms for machine learning models. Besides, the theoretical analysis of the error bound and the variance of the proposed algorithms are also presented in the paper. We have conducted extensive experiments on both real-world and synthetic datasets and demonstrated the high data utility of our proposed algorithms in the perspectives of simple data statistics tasks and complex machine learning tasks. The experimental results have shown that our proposed algorithms can effectively improve the data utility in different tasks while alleviating the privacy concerns of each individual.

PriPL-Tree: Accurate Range Query for Arbitrary Distribution under Local Differential Privacy

PriPL-Tree: Accurate Range Query for Arbitrary Distribution under Local Differential Privacy

A Range Query Scheme for Spatial Data with Shuffled Differential Privacy

AHEAD: Adaptive Hierarchical Decomposition for Range Query under Local Differential Privacy

An Efficient Heap Tree Based Range Query Scheme Under Local Differential Privacy

Toward Answering Federated Spatial Range Queries Under Local Differential Privacy

PrivTree

Collecting Partial Ordered Data With Local Differential Privacy

Differentially Private Spatial Decompositions

Local Differential Privacy for data collection and analysis

Answering Spatial Density Queries Under Local Differential Privacy

Local Differential Privacy and Its Applications: A Comprehensive Survey

Privacy-Preserving Outlier Detection with High Efficiency over Distributed Datasets

FLDP: Flexible strategy for local differential privacy

EPLQ: Efficient Privacy-Preserving Location-Based Query over Outsourced Encrypted Data.

Towards Efficient and Privacy-Preserving High-Dimensional Range Query in Cloud

Differentially private data release through multidimensional partitioning

Joint Distribution Analysis for Set-Valued Data With Local Differential Privacy

PriVDT: An Efficient Two-Party Cryptographic Framework for Vertical Decision Trees

PrivBV: Distance-aware Encoding for Distributed Data with Local Differential Privacy

Optimal Locally Private Nonparametric Classification with Public Data