Abstract:Entity matching (EM) is the problem of determining whether two records refer to same real-world entity, which is crucial in data integration, e.g., for product catalogs or address databases. A major drawback of many EM approaches is their dependence on labelled examples. We thus focus on the challenging setting of zero-shot entity matching where no labelled examples are available for an unseen target dataset. Recently, large language models (LLMs) have shown promising results for zero-shot EM, but their low throughput and high deployment cost limit their applicability and scalability. We revisit the zero-shot EM problem with AnyMatch, a small language model fine-tuned in a transfer learning setup. We propose several novel data selection techniques to generate fine-tuning data for our model, e.g., by selecting difficult pairs to match via an AutoML filter, by generating additional attribute-level examples, and by controlling label imbalance in the data. We conduct an extensive evaluation of the prediction quality and deployment cost of our model, in a comparison to thirteen baselines on nine benchmark datasets. We find that AnyMatch provides competitive prediction quality despite its small parameter size: it achieves the second-highest F1 score overall, and outperforms several other approaches that employ models with hundreds of billions of parameters. Furthermore, our approach exhibits major cost benefits: the average prediction quality of AnyMatch is within 4.4% of the state-of-the-art method MatchGPT with the proprietary trillion-parameter model GPT-4, yet AnyMatch requires four orders of magnitude less parameters and incurs a 3,899 times lower inference cost (in dollars per 1,000 tokens).

ZeroMatcher: A Cost-Off Entity Matching System

ZeroMatcher

Reserch of Entity Matching Based on Multiple Heterogenous Data

An Easy-to-use Evaluation Framework for Benchmarking Entity Recognition and Disambiguation Systems.

MultiEM: Efficient and Effective Unsupervised Multi-Table Entity Matching

AnyMatch -- Efficient Zero-Shot Entity Matching with a Small Language Model

Multi-Context Attention for Entity Matching.

JointMatcher: Numerically-aware entity matching using pre-trained language models with attention concentration

Match, Compare, or Select? An Investigation of Large Language Models for Entity Matching

GNEM: A Generic One-to-Set Neural Entity Matching Framework

PromptEM: Prompt-tuning for Low-resource Generalized Entity Matching

Bridging the Gap between Reality and Ideality of Entity Matching: A Revisiting and Benchmark Re-Construction

Crowd-Guided Entity Matching with Consolidated Textual Data

Fusion Makes Perfection: An Efficient Multi-Grained Matching Approach for Zero-Shot Relation Extraction

Epems: An Entity Matching System For E-Commerce Products

CTextEM: Employing Compound Textual Information in Entity Matching

CTextEM: Using Consolidated Textual Data for Entity Matching

A General Framework to Resolve the MisMatch Problem in XML Keyword Search

Interpretable and Low-Resource Entity Matching Via Decoupling Feature Learning from Decision Making

SETEM: Self-ensemble training with Pre-trained Language Models for Entity Matching

A Comprehensive Benchmark Framework for Active Learning Methods in Entity Matching