Abstract:This paper investigates the privacy funnel, a privacy-utility tradeoff problem in which mutual information quantifies both privacy and utility. The objective is to maximize utility while adhering to a specified privacy budget. However, the privacy funnel represents a non-convex optimization problem, making it challenging to achieve an optimal solution. An existing proposed approach to this problem involves substituting the mutual information with the lift (the exponent of information density) and then solving the optimization. Since mutual information is the expectation of the information density, this substitution overestimates the privacy loss and results in a final smaller bound on the privacy of mutual information than what is allowed in the budget. This significantly compromises the utility. To overcome this limitation, we propose using a privacy measure that is more relaxed than the lift but stricter than mutual information while still allowing the optimization to be efficiently solved. Instead of directly using information density, our proposed measure is the average of information density over the sensitive data distribution for each observed data realization. We then introduce a heuristic algorithm capable of achieving solutions that produce extreme privacy values, which enhances utility. The numerical results confirm improved utility at the same privacy budget compared to existing solutions in the literature. Additionally, we explore two other privacy measures, $\ell_{1}$-norm and strong $\chi^2$-divergence, demonstrating the applicability of our algorithm to these lift-based measures. We evaluate the performance of our method by comparing its output with previous works. Finally, we validate our heuristic approach with a theoretical framework that estimates the optimal utility for strong $\chi^2$-divergence, numerically showing a perfect match.

On the Lift, Related Privacy Measures, and Applications to Privacy-Utility Tradeoffs

An Algorithm for Enhancing Privacy-Utility Tradeoff in the Privacy Funnel and Other Lift-based Measures

Privacy-Utility Tradeoff Based on $α$-lift

Utility Analysis and Enhancement of LDP Mechanisms in High-Dimensional Space

Unifying Privacy Measures via Maximal $(α,β)$-Leakage (M$α$beL)

Deciphering the Interplay between Local Differential Privacy, Average Bayesian Privacy, and Maximum Bayesian Privacy

Local Information Privacy and Its Application to Privacy-Preserving Data Aggregation

LDPTube: Theoretical Utility Benchmark and Enhancement for LDP Mechanisms in High-dimensional Space

On Local Mutual-Information Privacy

On the Statistical Complexity of Estimation and Testing under Privacy Constraints

Calibrating Practical Privacy Risks for Differentially Private Machine Learning

Information Density Bounds for Privacy

Privacy-Utility Tradeoffs under Constrained Data Release Mechanisms

Privacy accounting $\varepsilon$conomics: Improving differential privacy composition via a posteriori bounds

A Utility-aware Anonymization Model for Multiple Sensitive Attributes Based on Association Concealment

A note on privacy preserving iteratively reweighted least squares

(Local) Differential Privacy has NO Disparate Impact on Fairness

Exploring Machine Learning Privacy/Utility trade-off from a hyperparameters Lens

Data Disclosure with Non-zero Leakage and Non-invertible Leakage Matrix

Quantifying Privacy via Information Density

$α$-Mutual Information: A Tunable Privacy Measure for Privacy Protection in Data Sharing