Abstract:Entity resolution (ER) is a core problem in data integration. Many companies have lots of datasets where ER needs to be conducted to integrate the data. On the one hand, it is nontrivial for non-ER experts within companies to design ER solutions. On the other hand, most companies are reluctant to release their real datasets for multiple reasons (e.g., privacy issues). A typical solution from the machine learning (ML) and the statistical community is to create surrogate (a.k.a. analogous) datasets based on the real dataset, release these surrogate datasets to the public to train ML models, such that these models trained on surrogate datasets can be either directly used or be adapted for the real dataset by the companies. In this paper, we study a new problem of synthesizing surrogate ER datasets using transformer models, with the goal that the ER model trained on the synthesized dataset can be used directly on the real dataset. We propose privacy preserving methods to synthesize ER datasets: we first learn the true similarity distributions of both matching and non-matching entity pairs from real dataset. We then devise algorithms that satisfy differential privacy and can synthesize fake but semantically meaningful entities, add matching and non-matching labels to these fake entity pairs, and ensure that the fake and real datasets have similar distributions. We also describe a method for entity rejection to avoid synthesizing bad fake entities that may destroy the original distributions. Extensive experiments show that ER matchers trained on real and synthetic ER datasets have very close performance on the same test sets - their $F1$ scores differ within 6% on 3 commonly used ER datasets, and their average precision, recall differences are less than 5%.

Synthesizing entity matching rules by examples

Liberal Entity Matching as a Compound AI Toolchain

Reserch of Entity Matching Based on Multiple Heterogenous Data

FairEM360: A Suite for Responsible Entity Matching

Data Extraction via Semantic Regular Expression Synthesis

Match, Compare, or Select? An Investigation of Large Language Models for Entity Matching

Bridging the Gap between Reality and Ideality of Entity Matching: A Revisiting and Benchmark Re-Construction

Learning from Natural Language Explanations for Generalizable Entity Matching

Synthesizing Privacy Preserving Entity Resolution Datasets

Effective entity matching with transformers

Interpretable and Low-Resource Entity Matching Via Decoupling Feature Learning from Decision Making

GNEM: A Generic One-to-Set Neural Entity Matching Framework

Synthesizing Relation-Aware Entity Transformation by Examples

Multi-Context Attention for Entity Matching.

CollaborEM: A Self-supervised Entity Matching Framework Using Multi-features Collaboration

MultiEM: Efficient and Effective Unsupervised Multi-Table Entity Matching

A Comprehensive Benchmark Framework for Active Learning Methods in Entity Matching

SynET: Synonym Expansion Using Transitivity

ZeroMatcher

xEM: Explainable Entity Matching in Customer 360

Rule-Based Method for Entity Resolution