Abstract:Abstract Business intelligence and AI services often involve the collection of copious amounts of multidimensional personal data. Since these data usually contain sensitive information of individuals, the direct collection can lead to privacy violations. Local differential privacy (LDP) is currently considered a state-ofthe-art solution for privacy-preserving data collection. However, existing LDP algorithms are not applicable to high-dimensional data; not only because of the increase in computation and communication cost, but also poor data utility. In this paper, we aim at addressing the curse-of-dimensionality problem in LDP-based high-dimensional data collection. Based on the idea of machine learning and data synthesis, we propose DP-F ed -W ae , an efficient privacy-preserving framework for collecting high-dimensional categorical data. With the combination of a generative autoencoder, federated learning, and differential privacy, our framework is capable of privately learning the statistical distributions of local data and generating high utility synthetic data on the server side without revealing users’ private information. We have evaluated the framework in terms of data utility and privacy protection on a number of real-world datasets containing 68–124 classification attributes. We show that our framework outperforms the LDP-based baseline algorithms in capturing joint distributions and correlations of attributes and generating high-utility synthetic data. With a local privacy guarantee ∈ = 8, the machine learning models trained with the synthetic data generated by the baseline algorithm cause an accuracy loss of 10% ~ 30%, whereas the accuracy loss is significantly reduced to less than 3% and at best even less than 1% with our framework. Extensive experimental results demonstrate the capability and efficiency of our framework in synthesizing high-dimensional data while striking a satisfactory utility-privacy balance.

Gaussian Differentially Private Human Faces Under a Face Radial Curve Representation

RDP: Ranked Differential Privacy for Facial Feature Protection in Multiscale Sparsified Subspace

Differential Privacy for Class-based Data: A Practical Gaussian Mechanism

Gaussian Differential Privacy on Riemannian Manifolds

Gaussian3Diff: 3D Gaussian Diffusion for 3D Full Head Synthesis and Editing

A(DP)$^2$SGD: Asynchronous Decentralized Parallel Stochastic Gradient Descent with Differential Privacy

Differentially Private Synthetic Heavy-tailed Data

Privacy-Preserving High-dimensional Data Collection with Federated Generative Autoencoder

IdentityDP: Differential Private Identification Protection for Face Images

Directional Privacy for Deep Learning

Differentially Private Regression and Classification with Sparse Gaussian Processes

Private Geometric Median

Identification, Amplification and Measurement: A bridge to Gaussian Differential Privacy

Individual Privacy Accounting with Gaussian Differential Privacy

Differentially private Riemannian optimization

Gaussian Deja-vu: Creating Controllable 3D Gaussian Head-Avatars with Enhanced Generalization and Personalization Abilities

3D Gaussian Parametric Head Model

A Differentially Private Framework for the Dynamic Heterogeneous Redundant Architecture System in Cyberspace

Generation of Face Privacy-Protected Images Based on the Diffusion Model

DPPro: Differentially Private High-Dimensional Data Release Via Random Projection

Deep Learning with Gaussian Differential Privacy