Abstract:Synthetic data has been hailed as the silver bullet for privacy preserving data analysis. If a record is not real, then how could it violate a person's privacy? In addition, deep-learning based generative models are employed successfully to approximate complex high-dimensional distributions from data and draw realistic samples from this learned distribution. It is often overlooked though that generative models are prone to memorising many details of individual training records and often generate synthetic data that too closely resembles the underlying sensitive training data, hence violating strong privacy regulations as, e.g., encountered in health care. Differential privacy is the well-known state-of-the-art framework for guaranteeing protection of sensitive individuals' data, allowing aggregate statistics and even machine learning models to be released publicly without compromising privacy. The training mechanisms however often add too much noise during the training process, and thus severely compromise the utility of these private models. Even worse, the tight privacy budgets do not allow for many training epochs so that model quality cannot be properly controlled in practice. In this paper we explore an alternative approach for privately generating data that makes direct use of the inherent stochasticity in generative models, e.g., variational autoencoders. The main idea is to appropriately constrain the continuity modulus of the deep models instead of adding another noise mechanism on top. For this approach, we derive mathematically rigorous privacy guarantees and illustrate its effectiveness with practical experiments.

Differentially Private Synthetic Data with Private Density Estimation

Differentially Private Histogram Publication for Dynamic Datasets: an Adaptive Sampling Approach.

PrivSyn: Differentially Private Data Synthesis

Private sampling: a noiseless approach for generating differentially private synthetic data

Differentially Private Synthetic Data Using KD-Trees

Differentially Private Low-dimensional Synthetic Data from High-dimensional Datasets

Generating Poisson-Distributed Differentially Private Synthetic Data

Differentially Private Synthetic Heavy-tailed Data

Differentially Private Synthetic Data: Applied Evaluations and Enhancements

Differentially Private Data Generation with Missing Data

pMSE Mechanism: Differentially Private Synthetic Data with Maximal Distributional Similarity

Online Differentially Private Synthetic Data Generation

Differentially Private Sampling from Distributions

Evaluating Differentially Private Synthetic Data Generation in High-Stakes Domains

Private measures, random walks, and synthetic data

Privacy-preserving data release leveraging optimal transport and particle gradient descent

Noise-Aware Statistical Inference with Differentially Private Synthetic Data

Differentially Private Synthetic Data Generation via Lipschitz-Regularised Variational Autoencoders

Comparative Study of Differentially Private Data Synthesis Methods

Differentially Private Data Release for Mixed-type Data Via Latent Factor Models.