Abstract:In the era of big data, user data are often vertically partitioned and stored at different local parties. Exploring the data from all the local parties would enable data analysts to gain a better understanding of the user population from different perspectives. However, the publication of vertically-partitioned data faces a dilemma: on the one hand, the original data cannot be directly shared by local parties due to privacy concerns; on the other hand, independently privatizing the local datasets before publishing may break the potential correlation between the cross-party attributes and lead to a significant utility loss. Prior solutions compute the privatized multivariate distributions of different attribute sets for constructing a synthetic integrated dataset. However, these algorithms are only applicable for low-dimensional structured data and may suffer from large utility loss with the increase in data dimensionality. Following the idea of synthetic data generation, we propose VertiGAN, the first framework based on a generative adversarial network (GAN) for publishing vertically-partitioned data with privacy protection. The framework adopts a GAN model comprised of one multi-output global generator and multiple local discriminators. The generator is collaboratively trained by the server and local parties to learn the distribution of all parties' local data and is used to generate a high-utility synthetic integrated dataset on the server side. Additionally, we apply differential privacy (DP) during the training process to ensure strict privacy guarantees for the local data. We evaluate the framework's performance on a number of real-world datasets containing 68--1501 classification attributes and show that our framework is more capable of capturing joint distributions and cross-attribute correlations compared to statistics-based baseline algorithms. Moreover, with a privacy guarantee of epsilon=8, our framework achieves around a 2%~15% improvement in classification accuracy compared to the baseline algorithms. Extensive experimental results demonstrate the capability and efficiency of our framework in synthesizing vertically-partitioned data while striking a satisfactory utility-privacy balance.

Differentially Private Generative Decomposed Adversarial Network for Vertically Partitioned Data Sharing

PKDGAN: Private Knowledge Distillation with Generative Adversarial Networks

Differentially Private Generative Adversarial Network

Distributed GAN-Based Privacy-Preserving Publication of Vertically-Partitioned Data

Generalization in Generative Adversarial Networks: A Novel Perspective from Privacy Protection.

Federated Synthetic Data Generation with Differential Privacy

VFLGAN: Vertical Federated Learning-based Generative Adversarial Network for Vertically Partitioned Data Publication

GAN Driven Personalized Spatial Temporal Private Data Sharing in Cyber Physical Social Systems

Improving Correlation Capture in Generating Imbalanced Data using Differentially Private Conditional GANs

Differentially Private Data Sharing: Sharing Models versus Sharing Data

A self-attention-based differentially private tabular GAN with high data utility

Private FL-GAN: Differential Privacy Synthetic Data Generation Based on Federated Learning.

PPGAN: Privacy-preserving Generative Adversarial Network

Differentially private graph publishing with degree distribution preservation

RDP-GAN: A Rényi-Differential Privacy Based Generative Adversarial Network

A(DP)$^2$SGD: Asynchronous Decentralized Parallel Stochastic Gradient Descent with Differential Privacy

Differentially Private Data Generative Models

Private data sharing between decentralized users through the privGAN architecture

Differentially Private Releasing Via Deep Generative Model (technical Report)

Horizontally Partitioned Data Publication with Differential Privacy

GANobfuscator: Mitigating Information Leakage under GAN Via Differential Privacy