Abstract:Synthetic data is often presented as a method for sharing sensitive information in a privacy-preserving manner by reproducing the global statistical properties of the original data without disclosing sensitive information about any individual. In practice, as with other anonymization methods, privacy risks cannot be entirely eliminated. The residual privacy risks need instead to be ex-post assessed. We present Anonymeter, a statistical framework to jointly quantify different types of privacy risks in synthetic tabular datasets. We equip this framework with attack-based evaluations for the singling out, linkability, and inference risks, the three key indicators of factual anonymization according to the European General Data Protection Regulation (GDPR). To the best of our knowledge, we are the first to introduce a coherent and legally aligned evaluation of these three privacy risks for synthetic data, and to design privacy attacks which model directly the singling out and linkability risks. We demonstrate the effectiveness of our methods by conducting an extensive set of experiments that measure the privacy risks of data with deliberately inserted privacy leakages, and of synthetic data generated with and without differential privacy. Our results highlight that the three privacy risks reported by our framework scale linearly with the amount of privacy leakage in the data. Furthermore, we observe that synthetic data exhibits the lowest vulnerability against linkability, indicating one-to-one relationships between real and synthetic data records are not preserved. Finally, we demonstrate quantitatively that Anonymeter outperforms existing synthetic data privacy evaluation frameworks both in terms of detecting privacy leaks, as well as computation speed. To contribute to a privacy-conscious usage of synthetic data, we open source Anonymeter at <a class="link-external link-https" href="https://github.com/statice/anonymeter" rel="external noopener nofollow">this https URL</a>.

Data Anonymization for Data Protection on Publicly Recorded Data

Exploring AI-based Anonymization of Industrial Image and Video Data in the Context of Feature Preservation

AnonyNoise: Anonymizing Event Data with Smart Noise to Outsmart Re-Identification and Preserve Privacy

Towards Privacy Engineering for Real-Time Analytics in the Human-Centered Internet of Things

Automatic de-identification of data download packages

LDFA: Latent Diffusion Face Anonymization for Self-driving Applications

Predictive Privacy: Collective Data Protection in the Context of AI and Big Data

A Unified Framework for Quantifying Privacy Risk in Synthetic Data

Data De-anonymization : From Mobility Traces to On-line Social Networks

Privacy Issues and Data Protection in Big Data: A Case Study Analysis under GDPR

Privacy Risk Assessment for Synthetic Longitudinal Health Data

Using Video Cameras as a Research Tool in Public Spaces: Addressing Ethical and Information Governance Challenges Under Data Protection Legislation

Mobile Sensor Data Anonymization

Automated Anonymisation of Visual and Audio Data in Classroom Studies

Automatic Face Anonymization in Visual Data: Are we really well protected?

Predictive privacy: Collective data protection in the context of artificial intelligence and big data

Low-Latency Video Anonymization for Crowd Anomaly Detection: Privacy vs. Performance

General Graph Data De-Anonymization: From Mobility Traces To Social Networks

Privacy preserving local analysis of digital trace data: A proof-of-concept

Anonymization: The imperfect science of using data while preserving privacy

General Graph Data De-Anonymization