Abstract:Abstract Business intelligence and AI services often involve the collection of copious amounts of multidimensional personal data. Since these data usually contain sensitive information of individuals, the direct collection can lead to privacy violations. Local differential privacy (LDP) is currently considered a state-ofthe-art solution for privacy-preserving data collection. However, existing LDP algorithms are not applicable to high-dimensional data; not only because of the increase in computation and communication cost, but also poor data utility. In this paper, we aim at addressing the curse-of-dimensionality problem in LDP-based high-dimensional data collection. Based on the idea of machine learning and data synthesis, we propose DP-F ed -W ae , an efficient privacy-preserving framework for collecting high-dimensional categorical data. With the combination of a generative autoencoder, federated learning, and differential privacy, our framework is capable of privately learning the statistical distributions of local data and generating high utility synthetic data on the server side without revealing users’ private information. We have evaluated the framework in terms of data utility and privacy protection on a number of real-world datasets containing 68–124 classification attributes. We show that our framework outperforms the LDP-based baseline algorithms in capturing joint distributions and correlations of attributes and generating high-utility synthetic data. With a local privacy guarantee ∈ = 8, the machine learning models trained with the synthetic data generated by the baseline algorithm cause an accuracy loss of 10% ~ 30%, whereas the accuracy loss is significantly reduced to less than 3% and at best even less than 1% with our framework. Extensive experimental results demonstrate the capability and efficiency of our framework in synthesizing high-dimensional data while striking a satisfactory utility-privacy balance.

Locally Private High-Dimensional Crowdsourced Data Release Based on Copula Functions

Copula-Based Multi-Dimensional Crowdsourced Data Synthesis and Release with Local Privacy

LoPub: High-Dimensional Crowdsourced Data Publication with Local Differential Privacy.

High-Dimensional Crowdsourced Data Distribution Estimation with Local Privacy.

Bayesian Network-Based High-Dimensional Crowdsourced Data Publication with Local Differential Privacy

LoHDP: Adaptive local differential privacy for high‐dimensional data publishing

Locally differentially private high-dimensional data synthesis

Locally Differentially Private Multi-Dimensional Data Collection Via Haar Transform.

Differentially Private Non Parametric Copulas: Generating synthetic data with non parametric copulas under privacy guarantees

Utility Analysis and Enhancement of LDP Mechanisms in High-Dimensional Space

Multi-Party High-Dimensional Data Publishing Under Differential Privacy

Collecting Multi-type and Correlation-Constrained Streaming Sensor Data with Local Differential Privacy

DPCrowd: Privacy-Preserving and Communication-Efficient Decentralized Statistical Estimation for Real-Time Crowdsourced Data

Privacy-Preserving High-dimensional Data Collection with Federated Generative Autoencoder

CALM: Consistent Adaptive Local Marginal for Marginal Release under Local Differential Privacy.

DPCrowd: Privacy-preserving and Communication-efficient Decentralized Statistical Estimation for Real-time Crowd-sourced Data

Data release for machine learning via correlated differential privacy

Truth Inference on Sparse Crowdsourcing Data with Local Differential Privacy

PLDP:Personalized LDP for Collecting and Analyzing Multidimensional Data

Correlated Differential Privacy of Multiparty Data Release in Machine Learning

Towards Correlated Data Trading for High-Dimensional Private Data