Abstract:In local differential privacy (LDP), each user perturbs her data locally before sending the noisy data to a data collector. The latter then analyzes the data to obtain useful statistics. Unlike the setting of centralized differential privacy, in LDP the data collector never gains access to the exact values of sensitive data, which protects not only the privacy of data contributors but also the collector itself against the risk of potential data leakage. Existing LDP solutions in the literature are mostly limited to the case that each user possesses a tuple of numeric or categorical values, and the data collector computes basic statistics such as counts or mean values. To the best of our knowledge, no existing work tackles more complex data mining tasks such as heavy hitter discovery over set-valued data. In this paper, we present a systematic study of heavy hitter mining under LDP. We first review existing solutions, extend them to the heavy hitter estimation, and explain why their effectiveness is limited. We then propose LDPMiner, a two-phase mechanism for obtaining accurate heavy hitters with LDP. The main idea is to first gather a candidate set of heavy hitters using a portion of the privacy budget, and focus the remaining budget on refining the candidate set in a second phase, which is much more efficient budget-wise than obtaining the heavy hitters directly from the whole dataset. We provide both in-depth theoretical analysis and extensive experiments to compare LDPMiner against adaptations of previous solutions. The results show that LDPMiner significantly improves over existing methods. More importantly, LDPMiner successfully identifies the majority true heavy hitters in practical settings.

Privacy-Preserving Federated Heavy Hitter Analytics for Non-IID Data

Federated Heavy Hitter Analytics with Local Differential Privacy

Federated Heavy Hitters Discovery with Differential Privacy

Differentially Private Heavy Hitter Detection using Federated Analytics

Federated Patient Hashing.

Privacy preserving federated big data analysis

Privacy-Enhanced Federated Learning for Non-IID Data

Federated Graph Analytics with Differential Privacy

Differentially Private Federated Clustering over Non-IID Data

APPFed: A Hybrid Privacy-Preserving Framework for Federated Learning over Sensitive Data

Federated Statistical Analysis: Non-parametric Testing and Quantile Estimation

Privacy-preserving Quantification of Non-IID Degree in Federated Learning

Heavy Hitter Estimation over Set-Valued Data with Local Differential Privacy

Privacy-preserving federated mining of frequent itemsets.

APFed: Anti-Poisoning Attacks in Privacy-Preserving Heterogeneous Federated Learning.

Anonymous and Privacy-Preserving Federated Learning with Industrial Big Data

Privacy-Preserving Outlier Detection with High Efficiency over Distributed Datasets

A Federated Privacy-Preserving User Information Matching Algorithm

Locally Differentially Private Heavy Hitter Identification

Efficient Protocols for Heavy Hitter Identification with Local Differential Privacy