Abstract:Differentially private (DP) synthetic data sets are a solution for sharing data while preserving the privacy of individual data providers. Understanding the effects of utilizing DP synthetic data in end-to-end machine learning pipelines impacts areas such as health care and humanitarian action, where data is scarce and regulated by restrictive privacy laws. In this work, we investigate the extent to which synthetic data can replace real, tabular data in machine learning pipelines and identify the most effective synthetic data generation techniques for training and evaluating machine learning models. We investigate the impacts of differentially private synthetic data on downstream classification tasks from the point of view of utility as well as fairness. Our analysis is comprehensive and includes representatives of the two main types of synthetic data generation algorithms: marginal-based and GAN-based. To the best of our knowledge, our work is the first that: (i) proposes a training and evaluation framework that does not assume that real data is available for testing the utility and fairness of machine learning models trained on synthetic data; (ii) presents the most extensive analysis of synthetic data set generation algorithms in terms of utility and fairness when used for training machine learning models; and (iii) encompasses several different definitions of fairness. Our findings demonstrate that marginal-based synthetic data generators surpass GAN-based ones regarding model training utility for tabular data. Indeed, we show that models trained using data generated by marginal-based algorithms can exhibit similar utility to models trained using real data. Our analysis also reveals that the marginal-based synthetic data generator MWEM PGM can train models that simultaneously achieve utility and fairness characteristics close to those obtained by models trained with real data.

Synthesizing High-Utility Tabular Data with Enhanced Privacy Via Split-and-Discard Pre-Training

Quantifying and Mitigating Privacy Risks for Tabular Generative Models

Private Knowledge Transfer via Model Distillation with Generative Adversarial Networks

Generating tabular datasets under differential privacy

Differentially Private Tabular Data Synthesis using Large Language Models

DP-2Stage: Adapting Language Models as Differentially Private Tabular Data Generators

Tabular Data Synthesis with Differential Privacy: A Survey

PrivSyn: Differentially Private Data Synthesis

Assessment of Differentially Private Synthetic Data for Utility and Fairness in End-to-End Machine Learning Pipelines for Tabular Data

Privacy without Noisy Gradients: Slicing Mechanism for Generative Model Training

Leveraging Programmatically Generated Synthetic Data for Differentially Private Diffusion Training

CTAB-GAN+: enhancing tabular data synthesis

Learning Privacy-Preserving Student Networks via Discriminative-Generative Distillation

DP-TBART: A Transformer-based Autoregressive Model for Differentially Private Tabular Data Generation

Differentially Private Synthetic Data Generation via Lipschitz-Regularised Variational Autoencoders

HT-Fed-GAN: Federated Generative Model for Decentralized Tabular Data Synthesis

Privately generating tabular data using language models

Graphical vs. Deep Generative Models: Measuring the Impact of Differentially Private Mechanisms and Budgets on Utility

Federated Synthetic Data Generation with Differential Privacy