Abstract:A large amount of personal health data that is highly valuable to the scientific community is still not accessible or requires a lengthy request process due to privacy concerns and legal restrictions. As a solution, synthetic data has been studied and proposed to be a promising alternative to this issue. However, generating realistic and privacy-preserving synthetic personal health data retains challenges such as simulating the characteristics of the patients' data that are in the minority classes, capturing the relations among variables in imbalanced data and transferring them to the synthetic data, and preserving individual patients' privacy. In this paper, we propose a differentially private conditional Generative Adversarial Network model (DP-CGANS) consisting of data transformation, sampling, conditioning, and network training to generate realistic and privacy-preserving personal data. Our model distinguishes categorical and continuous variables and transforms them into latent space separately for better training performance. We tackle the unique challenges of generating synthetic patient data due to the special data characteristics of personal health data. For example, patients with a certain disease are typically the minority in the dataset and the relations among variables are crucial to be observed. Our model is structured with a conditional vector as an additional input to present the minority class in the imbalanced data and maximally capture the dependency between variables. Moreover, we inject statistical noise into the gradients in the networking training process of DP-CGANS to provide a differential privacy guarantee. We extensively evaluate our model with state-of-the-art generative models on personal socio-economic datasets and real-world personal health datasets in terms of statistical similarity, machine learning performance, and privacy measurement. We demonstrate that our model outperforms other comparable models, especially in capturing the dependence between variables. Finally, we present the balance between data utility and privacy in synthetic data generation considering the different data structures and characteristics of real-world personal health data such as imbalanced classes, abnormal distributions, and data sparsity.

Differentially Private Normalizing Flows for Density Estimation, Data Synthesis, and Variational Inference with Application to Electronic Health Records

Differentially Private Synthetic Data with Private Density Estimation

Generation of Differentially Private Heterogeneous Electronic Health Records

Differentially Private Synthetic Data Generation via Lipschitz-Regularised Variational Autoencoders

Differentially Private Variational Inference for Non-conjugate Models

Are Normalizing Flows the Key to Unlocking the Exponential Mechanism? A Path through the Accuracy-Privacy Ceiling Constraining Differentially Private ML

Evaluating Differentially Private Synthetic Data Generation in High-Stakes Domains

Conditional Density Estimations from Privacy-Protected Data

Differentially Private Synthetic Heavy-tailed Data

On Differentially Private 3D Medical Image Synthesis with Controllable Latent Diffusion Models

Are Normalizing Flows the Key to Unlocking the Exponential Mechanism?

Differentially Private Synthetic Data: Applied Evaluations and Enhancements

Differentially Private Synthetic Data Using KD-Trees

Patient-Driven Privacy Control through Generalized Distillation

A Fully Private Pipeline for Deep Learning on Electronic Health Records

Generating synthetic personal health data using conditional generative adversarial networks combining with differential privacy

Model Conversion via Differentially Private Data-Free Distillation

Assessment of Differentially Private Synthetic Data for Utility and Fairness in End-to-End Machine Learning Pipelines for Tabular Data

Differentially Private Language Models for Secure Data Sharing

The Normal Distributions Indistinguishability Spectrum and its Application to Privacy-Preserving Machine Learning