Knowledge-embodied Attention for Distantly Supervised Relation Extraction

Kejun Deng,Xuemiao Zhang,Songtao Ye,Junfei Liu
DOI: https://doi.org/10.3233/ida-194476
IF: 1.7
2020-01-01
Intelligent Data Analysis
Abstract:Knowledge bases (KBs) provide a large amount of structured information for entities and relations, which are successfully leveraged in many natural language processing tasks. However, distantly supervised relation extraction only utilizes KBs to automatically generate datasets, while ignoring the background information in KBs during the relation extraction process. We herein propose a knowledge-embodied attention that leverages knowledge information in KBs to reduce the impact of noisy data for distantly supervised relation extraction. Specifically, we pre-train distributed representations of KBs with the knowledge representation learning (KRL) model, and subsequently incorporate them into relation extraction to learn sentence-level attention weights. The experimental results demonstrate that our approach outperforms all baselines, thus indicating that we can focus our attention on valid data by leveraging background information in KBs.
What problem does this paper attempt to address?