Abstract:Synthetic data is emerging as a promising way to harness the value of data, while reducing privacy risks. The potential of synthetic data is not limited to privacy-friendly data release, but also includes complementing real data in use-cases such as training machine learning algorithms that are more fair and robust to distribution shifts etc. There is a lot of interest in algorithmic advances in synthetic data generation for providing better privacy and statistical guarantees and for its better utilisation in machine learning pipelines. However, for responsible and trustworthy synthetic data generation, it is not sufficient to focus only on these algorithmic aspects and instead, a holistic view of the synthetic data generation pipeline must be considered. We build a novel system that allows the contributors of real data to autonomously participate in differentially private synthetic data generation without relying on a trusted centre. Our modular, general and scalable solution is based on three building blocks namely: Solid (Social Linked Data), MPC (Secure Multi-Party Computation) and Trusted Execution Environments (TEEs). Solid is a specification that lets people store their data securely in decentralised data stores called Pods and control access to their data. MPC refers to the set of cryptographic methods for different parties to jointly compute a function over their inputs while keeping those inputs private. TEEs such as Intel SGX rely on hardware based features for confidentiality and integrity of code and data. We show how these three technologies can be effectively used to address various challenges in responsible and trustworthy synthetic data generation by ensuring: 1) contributor autonomy, 2) decentralisation, 3) privacy and 4) scalability. We support our claims with rigorous empirical results on simulated and real datasets and different synthetic data generation algorithms.

Decouple-and-Sample: Protecting sensitive information in task agnostic data release

EdgeSanitizer: Locally Differentially Private Deep Inference at the Edge for Mobile Data Analytics

DP-CDA: An Algorithm for Enhanced Privacy Preservation in Dataset Synthesis Through Randomized Mixing

Utility-aware Privacy-preserving Data Releasing

Privacy-preserving data release leveraging optimal transport and particle gradient descent

Toward sensitive document release with privacy guarantees

Speech Sanitizer: Speech Content Desensitization and Voice Anonymization

Censoring chemical data to mitigate dual use risk

Guarding Multiple Secrets: Enhanced Summary Statistic Privacy for Data Sharing

PriSampler: Mitigating Property Inference of Diffusion Models

Decentralised, Scalable and Privacy-Preserving Synthetic Data Generation

SAFES: Sequential Privacy and Fairness Enhancing Data Synthesis for Responsible AI

Managing Your Private and Public Data: Bringing Down Inference Attacks Against Your Privacy

Privacy-Preserving Data Analysis for the Federal Statistical Agencies

Lightweight Privacy Protection via Adversarial Sample

MaSS: Multi-attribute Selective Suppression for Utility-preserving Data Transformation from an Information-theoretic Perspective

SPECIAL: Synopsis Assisted Secure Collaborative Analytics

The Empirical Impact of Data Sanitization on Language Models

Samplable Anonymous Aggregation for Private Federated Data Analysis

Privacy-Preserving Deep Learning Using Deformable Operators for Secure Task Learning

Securing Sensitive Medical Information with Basic and Pre-large Coati Optimization Algorithm for E-Health System Data Sanitation