Abstract:For information security, entity and relation extraction can be applied in sensitive information protection, data leakage detection, and other aspects. The current approaches to entity relation extraction not only ignore the relevance and dependency between name entity recognition and relation extraction but also may result in the cumulative propagation of errors. To solve this problem, it is proposed that an end-to-end joint entity and relation extraction model based on the Attention mechanism and Graph Convolutional Network (GCN) to simultaneously extract named entities and their relationships. The model includes three parts: the detection of entity span, the construction of an entity relation weighted graph, and the inference of entity relation type. Firstly, the detection of entity spans is viewed as a sequence labeling problem, and a multi-feature fusion approach for word embedding representation is designed to calculate all entity spans in a sentence to form an entity span matrix. Secondly, the entity span matrix is employed in the Multi-Head Attention mechanism for constructing the weighted adjacency matrix of the entity relation graph. Finally, for the inference of entity relation type, considering the interaction between entities and relations, the entity span matrix and relation connection matrix are simultaneously fed into the GCN for integrated extraction of entities and relations. Our model is evaluated on the public NYT dataset, attaining a precision of 66.4%, a recall of 63.1%, and an F1 score of 64.7% for joint entity and relation extraction, significantly outperforming other approaches. Experiments demonstrate that the proposed model is helpful for inferring entities and relations, considering the interaction between entities and relations through the Attention mechanism and GCN.

Syntax-Informed Self-Attention Network for Span-Based Joint Entity and Relation Extraction

Span-based joint entity and relation extraction augmented with sequence tagging mechanism

Span-based single-stage joint entity-relation extraction model

A Span-based Multi-Modal Attention Network for joint entity-relation extraction

Joint Extraction of Entities and Relations Based on Multi-feature Fusion

Syntax-aware entity representations for neural relation extraction.

Boosting Span-based Joint Entity and Relation Extraction via Squence Tagging Mechanism

Joint extraction of entities and relations via an entity correlated attention neural model

Entity-Aware Self-Attention and Contextualized GCN for Enhanced Relation Extraction in Long Sentences

ER-LAC: Span-Based Joint Entity and Relation Extraction Model with Multi-Level Lexical and Attention on Context Features

SEE: Syntax-Aware Entity Embedding for Neural Relation Extraction

Joint Model of Entity Recognition and Relation Extraction with Self-attention Mechanism

Integrated Extraction of Entities and Relations via Attentive Graph Convolutional Networks

Boundary assembling method for joint entity and relation extraction

Entity relation joint extraction model combining pointer network and attention mechanism based on relative position embedding

Construction and Application of Text Entity Relation Joint Extraction Model Based on Multi-Head Attention Neural Network

A Two-Phase Paradigm for Joint Entity-Relation Extraction

Joint extraction of entities and relations based on character graph convolutional network and Multi-Head Self-Attention Mechanism

Attention-Based Convolutional Neural Network for Semantic Relation Extraction.

A region-based hypergraph network for joint entity-relation extraction

A multiple head selection joint entity-relation extraction model