Decentralised, Scalable and Privacy-Preserving Synthetic Data Generation

Vishal Ramesh,Rui Zhao,Naman Goel

2023-10-31

Abstract:Synthetic data is emerging as a promising way to harness the value of data, while reducing privacy risks. The potential of synthetic data is not limited to privacy-friendly data release, but also includes complementing real data in use-cases such as training machine learning algorithms that are more fair and robust to distribution shifts etc. There is a lot of interest in algorithmic advances in synthetic data generation for providing better privacy and statistical guarantees and for its better utilisation in machine learning pipelines. However, for responsible and trustworthy synthetic data generation, it is not sufficient to focus only on these algorithmic aspects and instead, a holistic view of the synthetic data generation pipeline must be considered. We build a novel system that allows the contributors of real data to autonomously participate in differentially private synthetic data generation without relying on a trusted centre. Our modular, general and scalable solution is based on three building blocks namely: Solid (Social Linked Data), MPC (Secure Multi-Party Computation) and Trusted Execution Environments (TEEs). Solid is a specification that lets people store their data securely in decentralised data stores called Pods and control access to their data. MPC refers to the set of cryptographic methods for different parties to jointly compute a function over their inputs while keeping those inputs private. TEEs such as Intel SGX rely on hardware based features for confidentiality and integrity of code and data. We show how these three technologies can be effectively used to address various challenges in responsible and trustworthy synthetic data generation by ensuring: 1) contributor autonomy, 2) decentralisation, 3) privacy and 4) scalability. We support our claims with rigorous empirical results on simulated and real datasets and different synthetic data generation algorithms.

Cryptography and Security,Machine Learning

What problem does this paper attempt to address?

The paper aims to address several core issues in synthetic data generation, including decentralization, privacy protection, and scalability. Specifically:

1. **Privacy Protection**: Existing data-sharing methods face numerous challenges in terms of privacy. Synthetic data, as an emerging approach, can simulate the statistical characteristics of real data while reducing privacy risks. However, most existing synthetic data generation methods rely on a centralized authority to handle the data, which can lead to trust issues and potential security vulnerabilities.

2. **Decentralization**: To overcome the problems brought by centralized management, the paper proposes a decentralized synthetic data generation system that allows data contributors to autonomously participate in the synthetic data generation process without relying on a centralized trusted third party. This decentralized architecture helps to improve transparency and accountability in the data processing process.

3. **Scalability**: While ensuring privacy, existing multi-party computation (MPC) schemes have limitations in terms of computational cost and communication overhead, which restricts their application to large-scale datasets. Therefore, the paper proposes a technical solution that combines MPC with Trusted Execution Environments (TEE) to achieve a more efficient and scalable synthetic data generation process.

Through the above methods, the research team hopes to build a synthetic data generation system that can protect individual privacy while meeting the needs of machine learning, thereby promoting the development of responsible and trustworthy artificial intelligence technology.