Abstract:For information security, entity and relation extraction can be applied in sensitive information protection, data leakage detection, and other aspects. The current approaches to entity relation extraction not only ignore the relevance and dependency between name entity recognition and relation extraction but also may result in the cumulative propagation of errors. To solve this problem, it is proposed that an end-to-end joint entity and relation extraction model based on the Attention mechanism and Graph Convolutional Network (GCN) to simultaneously extract named entities and their relationships. The model includes three parts: the detection of entity span, the construction of an entity relation weighted graph, and the inference of entity relation type. Firstly, the detection of entity spans is viewed as a sequence labeling problem, and a multi-feature fusion approach for word embedding representation is designed to calculate all entity spans in a sentence to form an entity span matrix. Secondly, the entity span matrix is employed in the Multi-Head Attention mechanism for constructing the weighted adjacency matrix of the entity relation graph. Finally, for the inference of entity relation type, considering the interaction between entities and relations, the entity span matrix and relation connection matrix are simultaneously fed into the GCN for integrated extraction of entities and relations. Our model is evaluated on the public NYT dataset, attaining a precision of 66.4%, a recall of 63.1%, and an F1 score of 64.7% for joint entity and relation extraction, significantly outperforming other approaches. Experiments demonstrate that the proposed model is helpful for inferring entities and relations, considering the interaction between entities and relations through the Attention mechanism and GCN.

Deep Neural Networks for Relation Extraction

End-to-End Neural Relation Extraction Using Deep Biaffine Attention

Attention-Based Convolutional Neural Network for Semantic Relation Extraction.

Syntax-aware entity representations for neural relation extraction.

Effective Modeling of Encoder-Decoder Architecture for Joint Entity and Relation Extraction

Deep Neural Approaches to Relation Triplets Extraction: A Comprehensive Survey

SEE: Syntax-Aware Entity Embedding for Neural Relation Extraction

RECA: Relation Extraction Based on Cross-Attention Neural Network

Neural Relation Extraction for Knowledge Base Enrichment

Neural relation extraction: a survey

A Survey Deep Learning Based Relation Extraction

Entity-Relation Extraction As Full Shallow Semantic Dependency Parsing

Recurrent neural networks with segment attention and entity description for relation extraction from clinical texts

Entity-Aware Self-Attention and Contextualized GCN for Enhanced Relation Extraction in Long Sentences

Integrated Extraction of Entities and Relations via Attentive Graph Convolutional Networks

Distantly Supervised Neural Network Model For Relation Extraction

WRTRe: Weighted Relative Position Transformer for Joint Entity and Relation Extraction.

Joint extraction of entities and relations via an entity correlated attention neural model

Maximizing Relation Extraction Potential: A Data-Centric Study to Unveil Challenges and Opportunities

Joint Extraction of Entity and Relation with Information Redundancy Elimination

Dual Attention Graph Convolutional Network for Relation Extraction