Abstract:The possibility for public attributes to disclose private information has caused widespread concern. Traditional privacy-preserving approaches have two limitations: 1) Approaches based on data anonymization or distortion often lead to poor utility-privacy trade-offs, and 2) approaches based on data encryption face heavy computational costs. These problems have prompted calls for an effective privacy-preserving framework that provides adequate privacy guarantees while maintaining good data utility. Inspired by denoising autoencoders, in this paper, we regard the information about privacy attributes contained in the public attributes as a kind of noise and design an ex ante privacy-preserving model called the Mutual Information Autoencoder (MIAE), which reconstructs the loss function of the original autoencoder by combining reconstruction errors and mutual information, and we introduce a trade-off coefficient to achieve utility-privacy trade-offs. To elucidate the superiority of the proposed model, we consider utility-privacy trade-offs with the expected distortion function as a metric of data utility and the joint mutual information as a metric of privacy disclosure, and then, we construct a convex optimization problem with multiple constraints based on rate-distortion theory. From an information theory perspective, we provide a lower bound for privacy disclosure with utility guarantees. Elaborate experiments over a real-world dataset reveal that as the level of expected distortion increases, the achievable bound obtained by MIAE exhibits a trend similar to that of the information-theoretic bound. When the expected distortion surpasses 2.2, the achievable bound obtained by MIAE also converges to 0, and the maximum gap between the achievable bound obtained by MIAE and the information-theoretic bound is no more than 1.4. Compared to existing models, MIAE can provide a tighter achievable bound and achieve good utility-privacy trade-offs.

On the Noise-Information Separation of a Private Principal Component Analysis Scheme

A Correlated Noise-assisted Decentralized Differentially Private Estimation Protocol, and its application to fMRI Source Separation

New Privacy Mechanism Design With Direct Access to the Private Data

Privacy and Security Trade-off in Interconnected Systems with Known or Unknown Privacy Noise Covariance

Differential Privacy with Higher Utility by Exploiting Coordinate-wise Disparity: Laplace Mechanism Can Beat Gaussian in High Dimensions

Noise-Aware Differentially Private Variational Inference

Data Disclosure with Non-zero Leakage and Non-invertible Leakage Matrix

Binary Mechanisms under Privacy-Preserving Noise

Differential Private Discrete Noise Adding Mechanism: Conditions, Properties and Optimization

Utility–Privacy Trade-Off in Distributed Machine Learning Systems

Approaching the Information-Theoretic Limit of Privacy Disclosure With Utility Guarantees

On Learning Cluster Coefficient of Private Networks

Differentially private and decentralized randomized power method

On the Privacy of Selection Mechanisms with Gaussian Noise

Noise Variance Optimization in Differential Privacy: A Game-Theoretic Approach Through Per-Instance Differential Privacy

Cauchy Principal Component Analysis

A Privacy-Preserving User-Centric Data-Sharing Scheme

Optimal Differentially Private PCA and Estimation for Spiked Covariance Matrices

A Differential Privacy Mechanism Design Under Matrix-Valued Query

PLAN: Variance-Aware Private Mean Estimation

Wishart Mechanism for Differentially Private Principal Components Analysis.