Abstract:In the era of big data, user data are often vertically partitioned and stored at different local parties. Exploring the data from all the local parties would enable data analysts to gain a better understanding of the user population from different perspectives. However, the publication of vertically-partitioned data faces a dilemma: on the one hand, the original data cannot be directly shared by local parties due to privacy concerns; on the other hand, independently privatizing the local datasets before publishing may break the potential correlation between the cross-party attributes and lead to a significant utility loss. Prior solutions compute the privatized multivariate distributions of different attribute sets for constructing a synthetic integrated dataset. However, these algorithms are only applicable for low-dimensional structured data and may suffer from large utility loss with the increase in data dimensionality. Following the idea of synthetic data generation, we propose VertiGAN, the first framework based on a generative adversarial network (GAN) for publishing vertically-partitioned data with privacy protection. The framework adopts a GAN model comprised of one multi-output global generator and multiple local discriminators. The generator is collaboratively trained by the server and local parties to learn the distribution of all parties' local data and is used to generate a high-utility synthetic integrated dataset on the server side. Additionally, we apply differential privacy (DP) during the training process to ensure strict privacy guarantees for the local data. We evaluate the framework's performance on a number of real-world datasets containing 68--1501 classification attributes and show that our framework is more capable of capturing joint distributions and cross-attribute correlations compared to statistics-based baseline algorithms. Moreover, with a privacy guarantee of epsilon=8, our framework achieves around a 2%~15% improvement in classification accuracy compared to the baseline algorithms. Extensive experimental results demonstrate the capability and efficiency of our framework in synthesizing vertically-partitioned data while striking a satisfactory utility-privacy balance.

Secure Two-Party Differentially Private Data Release for Vertically Partitioned Data

Horizontally Partitioned Data Publication with Differential Privacy

Differentially private data release for data mining

Multi-Party High-Dimensional Data Publishing Under Differential Privacy

Multi-Party Sequential Data Publishing Under Differential Privacy

Privacy-Preserving Utility Verification of the Data Published by Non-Interactive Differentially Private Mechanisms.

Differentially private data release through multidimensional partitioning

Differentially Private Data Publication with Multi-level Data Utility

Differentially Private Spatial Decompositions

Secure Two-Party Frequent Itemset Mining with Guaranteeing Differential Privacy

PEM: A Practical Differentially Private System for Large-Scale Cross-Institutional Data Mining.

Differentially Private High-Dimensional Data Publication via Markov Network

A Data Publishing System Based on Privacy Preservation

DPPro: Differentially Private High-Dimensional Data Release Via Random Projection

Mitigating Leakage from Data Dependent Communications in Decentralized Computing using Differential Privacy

Multi-level Privacy Preserving Data Publishing

Differentially Private Two-Party Top-$k$ Frequent Item Mining

Distributed GAN-Based Privacy-Preserving Publication of Vertically-Partitioned Data

Gradual Release of Sensitive Data under Differential Privacy

Differentially Private Language Models for Secure Data Sharing

pMSE Mechanism: Differentially Private Synthetic Data with Maximal Distributional Similarity