Abstract:The possibility for public attributes to disclose private information has caused widespread concern. Traditional privacy-preserving approaches have two limitations: 1) Approaches based on data anonymization or distortion often lead to poor utility-privacy trade-offs, and 2) approaches based on data encryption face heavy computational costs. These problems have prompted calls for an effective privacy-preserving framework that provides adequate privacy guarantees while maintaining good data utility. Inspired by denoising autoencoders, in this paper, we regard the information about privacy attributes contained in the public attributes as a kind of noise and design an ex ante privacy-preserving model called the Mutual Information Autoencoder (MIAE), which reconstructs the loss function of the original autoencoder by combining reconstruction errors and mutual information, and we introduce a trade-off coefficient to achieve utility-privacy trade-offs. To elucidate the superiority of the proposed model, we consider utility-privacy trade-offs with the expected distortion function as a metric of data utility and the joint mutual information as a metric of privacy disclosure, and then, we construct a convex optimization problem with multiple constraints based on rate-distortion theory. From an information theory perspective, we provide a lower bound for privacy disclosure with utility guarantees. Elaborate experiments over a real-world dataset reveal that as the level of expected distortion increases, the achievable bound obtained by MIAE exhibits a trend similar to that of the information-theoretic bound. When the expected distortion surpasses 2.2, the achievable bound obtained by MIAE also converges to 0, and the maximum gap between the achievable bound obtained by MIAE and the information-theoretic bound is no more than 1.4. Compared to existing models, MIAE can provide a tighter achievable bound and achieve good utility-privacy trade-offs.

A Distributed Privacy-Utility Tradeoff Method Using Distributed Lossy Source Coding with Side Information

Privacy-Utility Tradeoffs under Constrained Data Release Mechanisms

On Scalable Source Coding Problem with Side Information Privacy

Competitive Privacy in the Smart Grid: An Information-theoretic Approach

Utility Analysis and Enhancement of LDP Mechanisms in High-Dimensional Space

Discriminatory Lossy Source Coding: Side Information Privacy

Data-Driven Optimization for Utility Providers with Differential Privacy of Users' Energy Profile

Functional Privacy for Distributed Function Computation

Breaking the Communication-Privacy-Accuracy Tradeoff with F-Differential Privacy

Distributed and Cascade Lossy Source Coding with a Side Information "Vending Machine"

Utility–Privacy Trade-Off in Distributed Machine Learning Systems

Customized Local Differential Privacy for Multi-Agent Distributed Optimization

Huff-DP: Huffman Coding based Differential Privacy Mechanism for Real-Time Data

Data Utilization Versus Privacy Protection in Semantic Communications

Approaching the Information-Theoretic Limit of Privacy Disclosure With Utility Guarantees

Robust Privatization with Multiple Tasks and the Optimal Privacy-Utility Tradeoff

CODER: Protecting Privacy in Image Retrieval with Differential Privacy

Preserving Data-Privacy with Added Noises: Optimal Estimation and Privacy Analysis.

On the Tradeoff Between Data-Privacy and Utility for Data Publishing

Wireless Coded Distributed Learning with Gaussian-based Local Differential Privacy.

Improving Data Utility Through Game Theory in Personalized Differential Privacy.