Abstract:In relation to extraction tasks, distant supervision is a very effective method, which can automatically generate training data via aligning KBs and texts, thereby solving the problem of manually labeling data. However, distant supervision inevitably accompanies the wrong labeling problem. The paper presents a neural relation extraction method to deal with the problem of noisy words and poor feature information in the one-sentence bags generated by distant supervision. Previous studies mainly focus on sentence-level denoising and even bag-level denoising by designing neural networks. In the paper, we propose a piecewise convolutional neural network with position attention and similar bag attention for distant supervision relation extraction(PCNN-PATT-SBA). First, we propose a position attention based on Gaussian distribution, by modeling the position relationship between non-entity words and entity words to assign weights for the words of the sentence, which is expected to reduce the influence of those noisy words. In addition, we propose similar bag attention based on the feature similarity between different bags, which merges the features of similar bags to solve the problem of poor feature information in one-sentence bags. Experimental results on the New York Times dataset demonstrate the effectiveness of our proposed position attention and similar bag attention modules. Our method also achieves better relation extraction accuracy than state-of-the-art methods on this dataset. And compared to the bag-of-sentence attention model, the P value is increased by 6.9%, Compared with selective attention over instances (PCNN-ATT), an increase of 25.6%, compared to Instance-Level Adversarial Training (PCNN-HATT), an increase of 12.1%.

Gated Convolutional Neural Networks with Sentence-Related Selection for Distantly Supervised Relation Extraction.

Utilizing Entity-Based Gated Convolution and Multilevel Sentence Attention to Improve Distantly Supervised Relation Extraction

A Distant Supervised Relation Extraction Model with Two Denoising Strategies.

Distant Supervision for Relation Extraction via Piecewise Convolutional Neural Networks

Semantic Piecewise Convolutional Neural Network with Adaptive Negative Training for Distantly Supervised Relation Extraction

Piecewise convolutional neural networks with position attention and similar bag attention for distant supervision relation extraction

Gated graph convolutional network with enhanced representation and joint attention for distant supervised heterogeneous relation extraction

Distant Supervision for Relation Extraction with Neural Instance Selector.

Distant Supervised Relation Extraction on Pre-train Model with Improved Multi-label Attention Mechanism

Cross-Relation Cross-Bag Attention for Distantly-Supervised Relation Extraction.

Denoising Distant Supervision For Relation Extraction With Entropy Weight Method

A gated piecewise CNN with entity-aware enhancement for distantly supervised relation extraction

Distant Supervision Relation Extraction with Intra-Bag and Inter-Bag Attentions

Label-Free Distant Supervision for Relation Extraction via Knowledge Graph Embedding.

Reducing Wrong Labels for Distant Supervision Relation Extraction with Selective Capsule Network.

A Noise Adaptive Model for Distantly Supervised Relation Extraction

DNNRE: A Dynamic Neural Network for Distant Supervised Relation Extraction.

Distant Supervision for Relation Extraction Via Retrieval-based Neural Networks

Neural Relation Extraction with Selective Attention over Instances

Transfer Learning for Relation Extraction Via Relation-Gated Adversarial Learning

Relation Extraction Method Combining Clause Level Distant Supervision and Semi-supervised Ensemble Learning