Abstract:Entity Matching is the task of deciding whether two entity descriptions refer to the same real-world entity and is a central step in most data integration pipelines. Many state-of-the-art entity matching methods rely on pre-trained language models (PLMs) such as BERT or RoBERTa. Two major drawbacks of these models for entity matching are that (i) the models require significant amounts of task-specific training data and (ii) the fine-tuned models are not robust concerning out-of-distribution entities. This paper investigates using generative large language models (LLMs) as a less task-specific training data-dependent and more robust alternative to PLM-based matchers. Our study covers hosted and open-source LLMs, which can be run locally. We evaluate these models in a zero-shot scenario and a scenario where task-specific training data is available. We compare different prompt designs and the prompt sensitivity of the models and show that there is no single best prompt but needs to be tuned for each model/dataset combination. We further investigate (i) the selection of in-context demonstrations, (ii) the generation of matching rules, as well as (iii) fine-tuning a hosted LLM using the same pool of training data. Our experiments show that the best LLMs require no or only a few training examples to perform similarly to PLMs that were fine-tuned using thousands of examples. LLM-based matchers further exhibit higher robustness to unseen entities. We show that GPT4 can generate structured explanations for matching decisions. The model can automatically identify potential causes of matching errors by analyzing explanations of wrong decisions. We demonstrate that the model can generate meaningful textual descriptions of the identified error classes, which can help data engineers improve entity matching pipelines.

Plausible-Parrots @ MSP2023: Enhancing Semantic Plausibility Modeling using Entity and Event Knowledge

Can LMs Learn New Entities from Descriptions? Challenges in Propagating Injected Knowledge

Event knowledge in large language models: the gap between the impossible and the unlikely

Supervised Knowledge Makes Large Language Models Better In-context Learners

Decompose, Enrich, and Extract! Schema-aware Event Extraction using LLMs

A Simple but Effective Pluggable Entity Lookup Table for Pre-trained Language Models

An Enhanced Prompt-Based LLM Reasoning Scheme via Knowledge Graph-Integrated Collaboration

Knowledge Graph-Enhanced Large Language Models via Path Selection

Enhancing Text-based Knowledge Graph Completion with Zero-Shot Large Language Models: A Focus on Semantic Enhancement

Entity Matching using Large Language Models

Knowledge-Augmented Language Model and its Application to Unsupervised Named-Entity Recognition

Language Models as Zero-Shot Planners: Extracting Actionable Knowledge for Embodied Agents

Augmented Large Language Models with Parametric Knowledge Guiding

Knowledgeable Salient Span Mask for Enhancing Language Models As Knowledge Base

Give Us the Facts: Enhancing Large Language Models with Knowledge Graphs for Fact-aware Language Modeling

Do Large Language Model Understand Multi-Intent Spoken Language ?

ChatGPT is not Enough: Enhancing Large Language Models with Knowledge Graphs for Fact-aware Language Modeling

Addressing Hallucinations in Language Models with Knowledge Graph Embeddings as an Additional Modality

Learning to Extract Structured Entities Using Language Models