Abstract:Abstract Business intelligence and AI services often involve the collection of copious amounts of multidimensional personal data. Since these data usually contain sensitive information of individuals, the direct collection can lead to privacy violations. Local differential privacy (LDP) is currently considered a state-ofthe-art solution for privacy-preserving data collection. However, existing LDP algorithms are not applicable to high-dimensional data; not only because of the increase in computation and communication cost, but also poor data utility. In this paper, we aim at addressing the curse-of-dimensionality problem in LDP-based high-dimensional data collection. Based on the idea of machine learning and data synthesis, we propose DP-F ed -W ae , an efficient privacy-preserving framework for collecting high-dimensional categorical data. With the combination of a generative autoencoder, federated learning, and differential privacy, our framework is capable of privately learning the statistical distributions of local data and generating high utility synthetic data on the server side without revealing users’ private information. We have evaluated the framework in terms of data utility and privacy protection on a number of real-world datasets containing 68–124 classification attributes. We show that our framework outperforms the LDP-based baseline algorithms in capturing joint distributions and correlations of attributes and generating high-utility synthetic data. With a local privacy guarantee ∈ = 8, the machine learning models trained with the synthetic data generated by the baseline algorithm cause an accuracy loss of 10% ~ 30%, whereas the accuracy loss is significantly reduced to less than 3% and at best even less than 1% with our framework. Extensive experimental results demonstrate the capability and efficiency of our framework in synthesizing high-dimensional data while striking a satisfactory utility-privacy balance.

Accuracy and Privacy Evaluations of Collaborative Data Analysis

Privacy-Preserving Collaborative Deep Learning with Unreliable Participants.

Toward the Application of Differential Privacy to Data Collaboration

FedDCL: a federated data collaboration learning as a hybrid-type privacy-preserving framework based on federated learning and data collaboration

Privacy-preserving recommender system using the data collaboration analysis for distributed datasets

Privacy preserving data sharing and analysis for edge-based architectures

Decentralized Collaborative Learning Framework with External Privacy Leakage Analysis

Collaborative causal inference on distributed data

Federated learning for preserving data privacy in collaborative healthcare research

Privacy-Preserving High-dimensional Data Collection with Federated Generative Autoencoder

Distinguishing Good from Bad: Distributed-Collaborative-Representation-Based Data Fraud Detection in Federated Learning.

Data Distribution Shifts in (Industrial) Federated Learning as a Privacy Issue

New Solutions Based on the Generalized Eigenvalue Problem for the Data Collaboration Analysis

Fairness-Driven Private Collaborative Machine Learning

Federated Graph Analytics with Differential Privacy

Privacy-Preserving Generalized Linear Models using Distributed Block Coordinate Descent

Privacy-Aware Compression for Federated Data Analysis

Clients Collaborate: Flexible Differentially Private Federated Learning with Guaranteed Improvement of Utility-Privacy Trade-off

Distributed Modelling Approaches for Data Privacy Preserving

Privacy Preserving Collaborative Computing: Heterogeneous Privacy Guarantee and Efficient Incentive Mechanism

Private Dataset Generation Using Privacy Preserving Collaborative Learning