Abstract:Differential privacy (DP) is a promising tool for preserving privacy during data publication, as it provides strong theoretical privacy guarantees in face of adversaries with arbitrary background knowledge. Histogram, as the result of a set of count queries, serves as a core statistical tool to report data distributions and is in fact viewed as the fundamental method for many other statistical analysis such as range queries. It is an important form for data publishing. In this paper, we consider the scenario of publishing sensitive histogram data with differential privacy scheme. Existing work in this field has justified that, comparing to directly applying DP techniques (i.e., injecting noise) over the counts in histogram bins, grouping bins before noise injection is more effective (i.e., with higher utility) as it introduces much less error over the sanitized histogram given the same privacy budget. However, state-of-the-art works have not unveiled how the overall utility of a sanitized histogram can be affected by the balance between the privacy budget distributed between grouping and noise injection phases. In this work, we conduct a theoretical study towards how the probability of getting better groups can be improved such that the overall error introduced in sanitized histogram can be further reduced, which directly leads to a higher utility for the sanitized histograms. In particular, we show that the probability of achieving better grouping can be affected by two factors, namely privacy budget assigned in grouping and the normalized utility function used for selecting groups. Motivated by that, we propose a new DP histogram publishing scheme, namely Iterative Histogram Partition, in which we carefully assign privacy budget between grouping and injection phases based on our theoretical study. We also theoretically prove that ϵ\documentclass[12pt]{minimal}\usepackage{amsmath}\usepackage{wasysym}\usepackage{amsfonts}\usepackage{amssymb}\usepackage{amsbsy}\usepackage{mathrsfs}\usepackage{upgreek}\setlength{\oddsidemargin}{-69pt}\begin{document}$$\epsilon $$\end{document}-differential privacy can be achieved according to our new scheme. Moreover, we also show that, under the same privacy budget, our scheme exhibits less errors in the sanitized histograms comparing with state-of-the-art methods. We also extends the model to multi-dimensional histogram publication cases. Finally, empirical study over four real-world datasets also justifies that our scheme achieves the least error among series of state-of-the-art baseline methods.

A Utility-Optimized Framework for Personalized Private Histogram Estimation

Differentially Private Histogram Publication for Dynamic Datasets: an Adaptive Sampling Approach.

Utility Analysis and Enhancement of LDP Mechanisms in High-Dimensional Space

Improving the Utility in Differential Private Histogram Publishing: Theoretical Study and Practice

IHP: improving the utility in differential private histogram publication

MPLDP: Multi-level Personalized Local Differential Privacy Method

Local Differential Privacy for data collection and analysis

LDPTube: Theoretical Utility Benchmark and Enhancement for LDP Mechanisms in High-dimensional Space

Data-Driven Optimization for Utility Providers with Differential Privacy of Users' Energy Profile

Personalized Privacy-Preserving Data Aggregation for Histogram Estimation.

AdaPDP: Adaptive Personalized Differential Privacy.

Histogram Publication over Numerical Values under Local Differential Privacy

Privacy protection in government data sharing: an improved LDP-based approach

Locally Private Set-valued Data Analyses: Distribution and Heavy Hitters Estimation

PLDP:Personalized LDP for Collecting and Analyzing Multidimensional Data

Mean Estimation of Numerical Data Under (ε,δ) -Utility-Optimized Local Differential Privacy

Towards Accurate Histogram Publication under Differential Privacy.

Mean Estimation of Numerical Data under (ϵ, Δ)-Utility-optimized Local Differential Privacy

Locally Private Estimation with Public Features

Locally Differentially Private Heterogeneous Graph Aggregation with Utility Optimization

A Simple and Practical Method for Reducing the Disparate Impact of Differential Privacy