Abstract:Entity matching (EM) refers to the problem of identifying tuple pairs in one or more relations that refer to the same real world entities. Supervised machine learning (ML) approaches, and deep learning based approaches in particular, typically achieve state-of-the-art matching results. However, these approaches require many labeled examples, in the form of matching and non-matching pairs, which are expensive and time-consuming to label. In this paper, we introduce Panda, a weakly supervised system specifically designed for EM. Panda uses the same labeling function abstraction as Snorkel, where labeling functions (LF) are user-provided programs that can generate large amounts of (somewhat noisy) labels quickly and cheaply, which can then be combined via a labeling model to generate accurate final predictions. To support users developing LFs for EM, Panda provides an integrated development environment (IDE) that lives in a modern browser architecture. Panda's IDE facilitates the development, debugging, and life-cycle management of LFs in the context of EM tasks, similar to how IDEs such as Visual Studio or Eclipse excel in general-purpose programming. Panda's IDE includes many novel features purpose-built for EM, such as smart data sampling, a builtin library of EM utility functions, automatically generated LFs, visual debugging of LFs, and finally, an EM-specific labeling model. We show in this demo that Panda IDE can greatly accelerate the development of high-quality EM solutions using weak supervision.

What problem does this paper attempt to address?

The problem that this paper attempts to solve is to reduce the dependence on a large amount of labeled data in the Entity Matching (EM) task. Traditional supervised machine - learning methods, especially those based on deep learning, can usually achieve the state - of - the - art matching results in entity - matching tasks, but these methods require a large number of labeled examples, that is, matching and non - matching entity pairs, and this labeling work is both expensive and time - consuming. To solve this problem, the paper introduces a weakly - supervised system named Panda, which is specifically designed for entity - matching tasks. Panda utilizes the Labeling Functions (LF) abstraction similar to the Snorkel system. Users can quickly generate a large number (although possibly noisy) of labels by writing label functions, and these labels are then integrated through a label model to generate the final prediction results. The main contribution of Panda lies in providing an Integrated Development Environment (IDE), which supports users to develop, debug, and manage the entire life cycle of label functions in the browser architecture. Panda's IDE integrates many new features specifically designed for entity - matching tasks, such as intelligent data sampling, a built - in library of entity - matching utility functions, automatically generated label functions, visual debugging of label functions, and a label model optimized for entity - matching tasks. These features are aimed at accelerating the development process of high - quality entity - matching solutions while reducing the need for manually labeled data.

Demonstration of Panda: A Weakly Supervised Entity Matching System

SETEM: Self-ensemble training with Pre-trained Language Models for Entity Matching

Multi-Context Attention for Entity Matching.

APE: Active Learning-based Tooling for Finding Informative Few-shot Examples for LLM-based Entity Matching

A Comprehensive Benchmark Framework for Active Learning Methods in Entity Matching

Interpretable and Low-Resource Entity Matching Via Decoupling Feature Learning from Decision Making

Deep entity matching with adversarial active learning

MultiEM: Efficient and Effective Unsupervised Multi-Table Entity Matching

ZeroMatcher: A Cost-Off Entity Matching System

ZeroMatcher

Effective entity matching with transformers

Bridging the Gap between Reality and Ideality of Entity Matching: A Revisiting and Benchmark Re-Construction

Deep entity matching with pre-trained language models

Self-reinforcing Unsupervised Matching

PromptEM: Prompt-tuning for Low-resource Generalized Entity Matching

Weakly- and Semi-Supervised Object Detection with Expectation-Maximization Algorithm.

A Web Semantic-Based Text Analysis Approach for Enhancing Named Entity Recognition Using PU-Learning and Negative Sampling

JointMatcher: Numerically-aware entity matching using pre-trained language models with attention concentration

Fusion Makes Perfection: An Efficient Multi-Grained Matching Approach for Zero-Shot Relation Extraction

Leveraging Large Language Models for Entity Matching

Good Examples Make A Faster Learner: Simple Demonstration-based Learning for Low-resource NER