Abstract:This paper investigates the privacy funnel, a privacy-utility tradeoff problem in which mutual information quantifies both privacy and utility. The objective is to maximize utility while adhering to a specified privacy budget. However, the privacy funnel represents a non-convex optimization problem, making it challenging to achieve an optimal solution. An existing proposed approach to this problem involves substituting the mutual information with the lift (the exponent of information density) and then solving the optimization. Since mutual information is the expectation of the information density, this substitution overestimates the privacy loss and results in a final smaller bound on the privacy of mutual information than what is allowed in the budget. This significantly compromises the utility. To overcome this limitation, we propose using a privacy measure that is more relaxed than the lift but stricter than mutual information while still allowing the optimization to be efficiently solved. Instead of directly using information density, our proposed measure is the average of information density over the sensitive data distribution for each observed data realization. We then introduce a heuristic algorithm capable of achieving solutions that produce extreme privacy values, which enhances utility. The numerical results confirm improved utility at the same privacy budget compared to existing solutions in the literature. Additionally, we explore two other privacy measures, $\ell_{1}$-norm and strong $\chi^2$-divergence, demonstrating the applicability of our algorithm to these lift-based measures. We evaluate the performance of our method by comparing its output with previous works. Finally, we validate our heuristic approach with a theoretical framework that estimates the optimal utility for strong $\chi^2$-divergence, numerically showing a perfect match.

An Efficient Difference-of-Convex Solver for Privacy Funnel

An Expectation-Maximization Relaxed Method for Privacy Funnel

An Algorithm for Enhancing Privacy-Utility Tradeoff in the Privacy Funnel and Other Lift-based Measures

On Learning Cluster Coefficient of Private Networks

Differentially Private and Communication-Efficient Distributed Nonconvex Optimization Algorithms

Variational Approach for Privacy Funnel Optimization on Continuous Data

Utility Optimization of Federated Learning with Differential Privacy

Decentralized Nonconvex Optimization with Guaranteed Privacy and Accuracy

A Theoretical Analysis of Efficiency Constrained Utility-Privacy Bi-Objective Optimization in Federated Learning

Privacy-Preserving Convex Factorization Machine

Convex Optimization for Linear Query Processing under Approximate Differential Privacy

Distributed Least-Squares Optimization Solvers with Differential Privacy

Dynamic Privacy Allocation for Locally Differentially Private Federated Learning with Composite Objectives

Compressive Sensing Approaches for Sparse Distribution Estimation Under Local Privacy

Differentially Private Distributed Nonconvex Stochastic Optimization with Quantized Communication

Breaking the Communication-Privacy-Accuracy Tradeoff with F-Differential Privacy

Efficient federated learning privacy preservation method with heterogeneous differential privacy

Compressive Sensing Approaches for Sparse Distribution Estimation under Local Privacy

Customized Local Differential Privacy for Multi-Agent Distributed Optimization

Heterogeneous Differential-Private Federated Learning: Trading Privacy for Utility Truthfully.

Bring Your Own Algorithm for Optimal Differentially Private Stochastic Minimax Optimization