Abstract:In local differential privacy (LDP), each user perturbs her data locally before sending the noisy data to a data collector. The latter then analyzes the data to obtain useful statistics. Unlike the setting of centralized differential privacy, in LDP the data collector never gains access to the exact values of sensitive data, which protects not only the privacy of data contributors but also the collector itself against the risk of potential data leakage. Existing LDP solutions in the literature are mostly limited to the case that each user possesses a tuple of numeric or categorical values, and the data collector computes basic statistics such as counts or mean values. To the best of our knowledge, no existing work tackles more complex data mining tasks such as heavy hitter discovery over set-valued data. In this paper, we present a systematic study of heavy hitter mining under LDP. We first review existing solutions, extend them to the heavy hitter estimation, and explain why their effectiveness is limited. We then propose LDPMiner, a two-phase mechanism for obtaining accurate heavy hitters with LDP. The main idea is to first gather a candidate set of heavy hitters using a portion of the privacy budget, and focus the remaining budget on refining the candidate set in a second phase, which is much more efficient budget-wise than obtaining the heavy hitters directly from the whole dataset. We provide both in-depth theoretical analysis and extensive experiments to compare LDPMiner against adaptations of previous solutions. The results show that LDPMiner significantly improves over existing methods. More importantly, LDPMiner successfully identifies the majority true heavy hitters in practical settings.

Federated Heavy Hitters Discovery with Differential Privacy

Differentially Private Histogram Publication for Dynamic Datasets: an Adaptive Sampling Approach.

Federated Heavy Hitter Analytics with Local Differential Privacy

Differentially Private Heavy Hitter Detection using Federated Analytics

Privacy-Preserving Federated Heavy Hitter Analytics for Non-IID Data

Sample and Threshold Differential Privacy: Histograms and applications

Heavy Hitter Estimation over Set-Valued Data with Local Differential Privacy

Locally Differentially Private Heavy Hitter Identification

Federated Graph Analytics with Differential Privacy

Frequent Itemsets Mining with Differential Privacy over Large-Scale Data

SPoFC: A Framework for Stream Data Aggregation with Local Differential Privacy

An Effective Federated Recommendation Framework with Differential Privacy

Locally Differentially Private Frequent Pattern Mining for High-Dimensional Data in Mobile Smart Services

DPI: Ensuring Strict Differential Privacy for Infinite Data Streaming

Locally Private Set-valued Data Analyses: Distribution and Heavy Hitters Estimation

Efficient Protocols for Heavy Hitter Identification with Local Differential Privacy

Local Differentially Private Heavy Hitter Detection in Data Streams with Bounded Memory

Differentially Private Histogram Publishing Through Fractal Dimension For Dynamic Datasets

Mining Frequent Graph Patterns with Differential Privacy

Federated Experiment Design under Distributed Differential Privacy

Rescuedp: Real-Time Spatio-Temporal Crowd-Sourced Data Publishing with Differential Privacy