Abstract:Entity Matching is the task of deciding whether two entity descriptions refer to the same real-world entity and is a central step in most data integration pipelines. Many state-of-the-art entity matching methods rely on pre-trained language models (PLMs) such as BERT or RoBERTa. Two major drawbacks of these models for entity matching are that (i) the models require significant amounts of task-specific training data and (ii) the fine-tuned models are not robust concerning out-of-distribution entities. This paper investigates using generative large language models (LLMs) as a less task-specific training data-dependent and more robust alternative to PLM-based matchers. Our study covers hosted and open-source LLMs, which can be run locally. We evaluate these models in a zero-shot scenario and a scenario where task-specific training data is available. We compare different prompt designs and the prompt sensitivity of the models and show that there is no single best prompt but needs to be tuned for each model/dataset combination. We further investigate (i) the selection of in-context demonstrations, (ii) the generation of matching rules, as well as (iii) fine-tuning a hosted LLM using the same pool of training data. Our experiments show that the best LLMs require no or only a few training examples to perform similarly to PLMs that were fine-tuned using thousands of examples. LLM-based matchers further exhibit higher robustness to unseen entities. We show that GPT4 can generate structured explanations for matching decisions. The model can automatically identify potential causes of matching errors by analyzing explanations of wrong decisions. We demonstrate that the model can generate meaningful textual descriptions of the identified error classes, which can help data engineers improve entity matching pipelines.

KcMF: A Knowledge-compliant Framework for Schema and Entity Matching with Fine-tuning-free LLMs

Reserch of Entity Matching Based on Multiple Heterogenous Data

LLM-Align: Utilizing Large Language Models for Entity Alignment in Knowledge Graphs

Schema Matching with Large Language Models: an Experimental Study

Match, Compare, or Select? An Investigation of Large Language Models for Entity Matching

Two Heads Are Better Than One: Integrating Knowledge from Knowledge Graphs and Large Language Models for Entity Alignment

ReMatch: Retrieval Enhanced Schema Matching with LLMs

Extract, Define, Canonicalize: An LLM-based Framework for Knowledge Graph Construction

LLMs4OM: Matching Ontologies with Large Language Models

Knowledge-Aware Learning Framework Based on Schema Theory to Complement Large Learning Models

MCSFF: Multi-modal Consistency and Specificity Fusion Framework for Entity Alignment

Entity Alignment with Noisy Annotations from Large Language Models

An In-Context Schema Understanding Method for Knowledge Base Question Answering

Collaborative Knowledge Fusion: A Novel Approach for Multi-task Recommender Systems via LLMs

SCMEA: A stacked co-enhanced model for entity alignment based on multi-aspect information fusion and bidirectional contrastive learning

Disambiguate Entity Matching using Large Language Models through Relation Discovery

CMC: combining multiple schema-matching strategies based on credibility prediction

Entity Matching using Large Language Models

A New Complex Schema Matching System

Agent-OM: Leveraging LLM Agents for Ontology Matching

Efficient Knowledge Infusion via KG-LLM Alignment