Abstract:Distant supervised relation extraction has been an effective way to find relational facts from text. However, distant supervised method inevitably accompanies with wrongly labeled sentences. Noisy sentences lead to poor performance of relation extraction models. Though existing piecewise convolutional neural network model with sentence-level attention (PCNN+ATT) is an effective way to reduce the effect of noisy sentences, it still has two limitations. On one hand, it adopts a PCNN module as sentence encoder, which only captures local contextual features of words and might lose important information. On the other hand, it neglects the fact that not all words contribute equally to the semantics of sentences. To address these two issues, we propose a hierarchical attention-based bidirectional GRU (HA-BiGRU) model. For the first limitation, our model utilizes a BiGRU module in place of PCNN, so as to extract global contextual information. For the second limitation, our model combines word-level and sentence-level attention mechanisms, which help get accurate sentence representations. To further alleviate the wrongly labeling problem, we first calculate the co-occurrence probabilities (CP) between the shortest dependency path (SDP) and the relation labels. Based on these co-occurrence probabilities, two denoising strategies are proposed to reduce noise interference respectively from aspect of filtering labeled data and integrating CP information into model. Experimental results on the corpus of Freebase and New York Times (Freebase+NYT) show that the HA-BiGRU model outperforms baseline models, and the two co-occurrence probabilities based denoising strategies can improve robustness of HA-BiGRU model.

Utilizing Entity-Based Gated Convolution and Multilevel Sentence Attention to Improve Distantly Supervised Relation Extraction

Distant Supervision for Relation Extraction with Sentence-Level Attention and Entity Descriptions

Label-Free Distant Supervision for Relation Extraction via Knowledge Graph Embedding.

Cross-Relation Cross-Bag Attention for Distantly-Supervised Relation Extraction.

Distant Supervision for Relation Extraction with Hierarchical Selective Attention.

FGSI: distant supervision for relation extraction method based on fine-grained semantic information

Gated graph convolutional network with enhanced representation and joint attention for distant supervised heterogeneous relation extraction

Exploring Encoder-Decoder Model for Distant Supervised Relation Extraction

Distantly Supervised Relation Extraction Based on Residual Attention and Self Learning

ESRE: Handling Repeated Entities in Distant Supervised Relation Extraction

A Distant Supervised Relation Extraction Model with Two Denoising Strategies.

Distant Supervision Relation Extraction with Intra-Bag and Inter-Bag Attentions

Distant Supervision for Relation Extraction with Linear Attenuation Simulation and Non-IID Relevance Embedding.

Distant Supervised Relation Extraction on Pre-train Model with Improved Multi-label Attention Mechanism

Distant supervision for neural relation extraction integrated with word attention and property features

Effective Deep Memory Networks for Distant Supervised Relation Extraction.

Robust Neural Relation Extraction Via Multi-Granularity Noises Reduction

Semantic Piecewise Convolutional Neural Network with Adaptive Negative Training for Distantly Supervised Relation Extraction

From Bag of Sentences to Document: Distantly Supervised Relation Extraction via Machine Reading Comprehension

GAN Driven Semi-distant Supervision for Relation Extraction

Improving Distant Supervised Relation Extraction by Dynamic Neural Network