Abstract:The switch from a Model-Centric to a Data-Centric mindset is putting emphasis on data and its quality rather than algorithms, bringing forward new challenges. In particular, the sensitive nature of the information in highly regulated scenarios needs to be accounted for. Specific approaches to address the privacy issue have been developed, as Privacy Enhancing Technologies. However, they frequently cause loss of information, putting forward a crucial trade-off among data quality and privacy. A clever way to bypass such a conundrum relies on Synthetic Data: data obtained from a generative process, learning the real data properties. Both Academia and Industry realized the importance of evaluating synthetic data quality: without all-round reliable metrics, the innovative data generation task has no proper objective function to maximize. Despite that, the topic remains under-explored. For this reason, we systematically catalog the important traits of synthetic data quality and privacy, and devise a specific methodology to test them. The result is DAISYnt (aDoption of Artificial Intelligence SYnthesis): a comprehensive suite of advanced tests, which sets a de facto standard for synthetic data evaluation. As a practical use-case, a variety of generative algorithms have been trained on real-world Credit Bureau Data. The best model has been assessed, using DAISYnt on the different synthetic replicas. Further potential uses, among others, entail auditing and fine-tuning of generative models or ensuring high quality of a given synthetic dataset. From a prescriptive viewpoint, eventually, DAISYnt may pave the way to synthetic data adoption in highly regulated domains, ranging from Finance to Healthcare, through Insurance and Education.

DataSynth: generating synthetic data using declarative constraints

Data Generation Using Declarative Constraints

SynthDa: Exploiting Existing Real-World Data for Usable and Accessible Synthetic Data Generation

Enabling Synthetic Data adoption in regulated domains

High-Level Synthetic Data Generation with Data Set Archetypes

PrivSyn: Differentially Private Data Synthesis

GenSyn: A Multi-stage Framework for Generating Synthetic Microdata using Macro Data Sources

Synthcity: facilitating innovative use cases of synthetic data in different data modalities

Synthetic Data Applications in Finance

SynthCypher: A Fully Synthetic Data Generation Framework for Text-to-Cypher Querying in Knowledge Graphs

Trading Off Scalability, Privacy, and Performance in Data Synthesis

Source2Synth: Synthetic Data Generation and Curation Grounded in Real Data Sources

SynSys: A Synthetic Data Generation System for Healthcare Applications

Synthetic Data: Methods, Use Cases, and Risks

Synthetic data in biomedicine via generative artificial intelligence

Artificial Data, Real Insights: Evaluating Opportunities and Risks of Expanding the Data Ecosystem with Synthetic Data

Synthetic Data in Healthcare

On the Equivalency, Substitutability, and Flexibility of Synthetic Data

Reimagining Synthetic Tabular Data Generation through Data-Centric AI: A Comprehensive Benchmark

Boosting Data Analytics With Synthetic Volume Expansion

Structured Evaluation of Synthetic Tabular Data