Abstract:In the era of big data, user data are often vertically partitioned and stored at different local parties. Exploring the data from all the local parties would enable data analysts to gain a better understanding of the user population from different perspectives. However, the publication of vertically-partitioned data faces a dilemma: on the one hand, the original data cannot be directly shared by local parties due to privacy concerns; on the other hand, independently privatizing the local datasets before publishing may break the potential correlation between the cross-party attributes and lead to a significant utility loss. Prior solutions compute the privatized multivariate distributions of different attribute sets for constructing a synthetic integrated dataset. However, these algorithms are only applicable for low-dimensional structured data and may suffer from large utility loss with the increase in data dimensionality. Following the idea of synthetic data generation, we propose VertiGAN, the first framework based on a generative adversarial network (GAN) for publishing vertically-partitioned data with privacy protection. The framework adopts a GAN model comprised of one multi-output global generator and multiple local discriminators. The generator is collaboratively trained by the server and local parties to learn the distribution of all parties' local data and is used to generate a high-utility synthetic integrated dataset on the server side. Additionally, we apply differential privacy (DP) during the training process to ensure strict privacy guarantees for the local data. We evaluate the framework's performance on a number of real-world datasets containing 68--1501 classification attributes and show that our framework is more capable of capturing joint distributions and cross-attribute correlations compared to statistics-based baseline algorithms. Moreover, with a privacy guarantee of epsilon=8, our framework achieves around a 2%~15% improvement in classification accuracy compared to the baseline algorithms. Extensive experimental results demonstrate the capability and efficiency of our framework in synthesizing vertically-partitioned data while striking a satisfactory utility-privacy balance.

Privacy preserving growing neural gas over arbitrarily partitioned data

Protecting Data Privacy in Growing Neural Gas

GELU-Net: A Globally Encrypted, Locally Unencrypted Deep Neural Network for Privacy-Preserved Learning.

Privacy-Preserving Collaborative Deep Learning with Unreliable Participants.

GANs Based Density Distribution Privacy-Preservation on Mobility Data

Industrial Scale Privacy Preserving Deep Neural Network

Private Knowledge Transfer via Model Distillation with Generative Adversarial Networks

PKDGAN: Private Knowledge Distillation with Generative Adversarial Networks

Privacy Preserving Back-propagation Neural Network Learning over Arbitrarily Partitioned Data

Distributed Batch Learning of Growing Neural Gas for Quick and Efficient Clustering

Privacy-Preserved Neural Graph Databases

Practical Two-party Privacy-preserving Neural Network Based on Secret Sharing

A New Noise Generating Method Based on Gaussian Sampling for Privacy Preservation

P$$^2$$CG: a Privacy Preserving Collaborative Graph Neural Network Training Framework

Distributed GAN-Based Privacy-Preserving Publication of Vertically-Partitioned Data

Multi-Scale Batch-Learning Growing Neural Gas Efficiently for Dynamic Data Distributions

Privacy-preserving Backpropagation Neural Network Learning.

Privacy Budgeting for Growing Machine Learning Datasets

Privacy-preserving two-parties logistic regression on vertically partitioned data using asynchronous gradient sharing

A privacy-preserving algorithm for distributed training of neural network ensembles

Achieving Adaptive Privacy-Preserving Graph Neural Networks Training in Cloud Environment