Abstract:Local Differential Privacy (LDP) can provide each user with strong privacy guarantees under untrusted data curators while ensuring accurate statistics derived from privatized data. Due to its powerfulness, LDP has been widely adopted to protect privacy in various tasks (e.g., heavy hitters discovery, probability estimation) and systems (e.g., Google Chrome, Apple iOS). In particular, <math>(∊,δ)</math>-LDP has been studied in related statistical tasks like private learning and hypothesis testing, but is mainly achieved by using Gaussian mechanism, leading to the limited data utility. In this paper, we investigate several novel mechanisms that achieve <math>(∊,δ)</math>-LDP with higher data utility in collecting and analyzing users' data. Specifically, we first design two <math>(∊,δ)</math>-LDP algorithms for mean estimations on multi-dimensional numeric data, which can ensure higher accuracy than the optimal Gaussian mechanism. Then, we investigate different local protocols for frequency estimations on categorical attributes under <math>(∊,δ)</math>-LDP. Based on the proposed mechanisms, we further study on <math>(∊,δ)</math>-LDP-compliant stochastic gradient descent algorithms for machine learning models. Besides, the theoretical analysis of the error bound and the variance of the proposed algorithms are also presented in the paper. We have conducted extensive experiments on both real-world and synthetic datasets and demonstrated the high data utility of our proposed algorithms in the perspectives of simple data statistics tasks and complex machine learning tasks. The experimental results have shown that our proposed algorithms can effectively improve the data utility in different tasks while alleviating the privacy concerns of each individual.

Optimal Locally Private Data Stream Analytics

An Algorithm for Streaming Differentially Private Data

OptStream: Releasing Time Series Privately

Differentially Private Numerical Vector Analyses in the Local and Shuffle Model

Privacy Preserving Stream Analytics: The Marriage of Randomized Response and Approximate Computing

Locally Private Set-valued Data Analyses: Distribution and Heavy Hitters Estimation

LDP-IDS: Local Differential Privacy for Infinite Data Streams

DPI: Ensuring Strict Differential Privacy for Infinite Data Streaming

Improved Pan-Private Stream Density Estimation

Improved Differential Privacy for SGD via Optimal Private Linear Operators on Adaptive Streams

Differentially Private Event Sequences over Infinite Streams with Relaxed Privacy Guarantee

Streaming Data Collection With a Private Sketch-Based Protocol

Private Data Stream Analysis for Universal Symmetric Norm Estimation

Differentially Private Streaming Data Release under Temporal Correlations via Post-processing

Privacy-Aware Compression for Federated Data Analysis

Differentially Private Synthetic High-dimensional Tabular Stream

Locally Differentially Private Distributed Online Learning with Guaranteed Optimality

Hiding Numerical Vectors in Local Private and Shuffled Messages

Local Differential Privacy for data collection and analysis

Online Differentially Private Synthetic Data Generation