Heterogeneous Entity Matching with Complex Attribute Associations using BERT and Neural Networks

Shitao Wang,Jiamin Lu
2023-09-20
Abstract:Across various domains, data from different sources such as Baidu Baike and Wikipedia often manifest in distinct forms. Current entity matching methodologies predominantly focus on homogeneous data, characterized by attributes that share the same structure and concise attribute values. However, this orientation poses challenges in handling data with diverse formats. Moreover, prevailing approaches aggregate the similarity of attribute values between corresponding attributes to ascertain entity similarity. Yet, they often overlook the intricate interrelationships between attributes, where one attribute may have multiple associations. The simplistic approach of pairwise attribute comparison fails to harness the wealth of information encapsulated within <a class="link-external link-http" href="http://entities.To" rel="external noopener nofollow">this http URL</a> address these challenges, we introduce a novel entity matching model, dubbed Entity Matching Model for Capturing Complex Attribute Relationships(EMM-CCAR),built upon pre-trained models. Specifically, this model transforms the matching task into a sequence matching problem to mitigate the impact of varying data formats. Moreover, by introducing attention mechanisms, it identifies complex relationships between attributes, emphasizing the degree of matching among multiple attributes rather than one-to-one correspondences. Through the integration of the EMM-CCAR model, we adeptly surmount the challenges posed by data heterogeneity and intricate attribute interdependencies. In comparison with the prevalent DER-SSM and Ditto approaches, our model achieves improvements of approximately 4% and 1% in F1 scores, respectively. This furnishes a robust solution for addressing the intricacies of attribute complexity in entity matching.
Computation and Language
What problem does this paper attempt to address?
The paper aims to address the issue of complex attribute relationships in heterogeneous entity matching. Specifically: - **Main Problem**: Current entity matching methods primarily focus on homogeneous data (i.e., data with the same structure and concise attribute values) but face challenges when dealing with data of different formats. Additionally, existing methods typically aggregate the similarity between corresponding attribute values when determining entity similarity, ignoring the complex relationships between attributes. This leads to a simplified one-to-one attribute comparison method that cannot fully utilize the information contained within entities. - **Solution**: The paper proposes a new entity matching model—EMM-CCAR (Entity Matching Model for Capturing Complex Attribute Relationships). This model is based on a pre-trained model and transforms the matching task into a sequence matching problem to mitigate the impact of different data formats. By introducing an attention mechanism, the model can identify complex relationships between attributes and emphasize the matching degree among multiple attributes, rather than just a single one-to-one correspondence. Experimental results show that compared to existing methods (such as DER-SSM and Ditto), EMM-CCAR improves the F1 score by approximately 4% and 1%, respectively. In summary, the core objective of the paper is to better capture the complex relationships between attributes in heterogeneous data by utilizing pre-trained models and attention mechanisms, thereby improving the accuracy and robustness of entity matching.