Abstract:In relation to extraction tasks, distant supervision is a very effective method, which can automatically generate training data via aligning KBs and texts, thereby solving the problem of manually labeling data. However, distant supervision inevitably accompanies the wrong labeling problem. The paper presents a neural relation extraction method to deal with the problem of noisy words and poor feature information in the one-sentence bags generated by distant supervision. Previous studies mainly focus on sentence-level denoising and even bag-level denoising by designing neural networks. In the paper, we propose a piecewise convolutional neural network with position attention and similar bag attention for distant supervision relation extraction(PCNN-PATT-SBA). First, we propose a position attention based on Gaussian distribution, by modeling the position relationship between non-entity words and entity words to assign weights for the words of the sentence, which is expected to reduce the influence of those noisy words. In addition, we propose similar bag attention based on the feature similarity between different bags, which merges the features of similar bags to solve the problem of poor feature information in one-sentence bags. Experimental results on the New York Times dataset demonstrate the effectiveness of our proposed position attention and similar bag attention modules. Our method also achieves better relation extraction accuracy than state-of-the-art methods on this dataset. And compared to the bag-of-sentence attention model, the P value is increased by 6.9%, Compared with selective attention over instances (PCNN-ATT), an increase of 25.6%, compared to Instance-Level Adversarial Training (PCNN-HATT), an increase of 12.1%.

Attention-Based Convolutional Neural Networks for Chinese Relation Extraction

Attention-Based Convolutional Neural Network for Semantic Relation Extraction.

Convolution Neural Network for Relation Extraction

Piecewise Graph Convolutional Network with Edge-Level Attention for Relation Extraction

Hierarchical Attention Cnn And Entity-Aware For Relation Extraction

A Feature Combination-Based Graph Convolutional Neural Network Model for Relation Extraction

Improving Graph Convolutional Networks Based on Relation-Aware Attention for End-to-End Relation Extraction.

Domain Relation Extraction from Noisy Chinese Texts.

Piecewise convolutional neural network relation extraction with self-attention mechanism

RECA: Relation Extraction Based on Cross-Attention Neural Network

Relation Classification Via Multi-Level Attention CNNs.

End-to-end Relation Extraction Using Graph Convolutional Network with a Novel Entity Attention

Exploring Deep Belief Network for Chinese Relation Extraction.

Dual Attention Graph Convolutional Network for Relation Extraction

Distant Supervision for Relation Extraction via Piecewise Convolutional Neural Networks

Piecewise convolutional neural networks with position attention and similar bag attention for distant supervision relation extraction

A Robust Graph Convolutional Network for Relation Extraction by Combining Edge Information

Densely Connected Graph Attention Network Based on Iterative Path Reasoning for Document-Level Relation Extraction

Relation Extraction with Multi-instance Multi-label Convolutional Neural Networks.

Beyond Word Attention: Using Segment Attention in Neural Relation Extraction

Neural Relation Extraction with Multi-lingual Attention