Abstract:For information security, entity and relation extraction can be applied in sensitive information protection, data leakage detection, and other aspects. The current approaches to entity relation extraction not only ignore the relevance and dependency between name entity recognition and relation extraction but also may result in the cumulative propagation of errors. To solve this problem, it is proposed that an end-to-end joint entity and relation extraction model based on the Attention mechanism and Graph Convolutional Network (GCN) to simultaneously extract named entities and their relationships. The model includes three parts: the detection of entity span, the construction of an entity relation weighted graph, and the inference of entity relation type. Firstly, the detection of entity spans is viewed as a sequence labeling problem, and a multi-feature fusion approach for word embedding representation is designed to calculate all entity spans in a sentence to form an entity span matrix. Secondly, the entity span matrix is employed in the Multi-Head Attention mechanism for constructing the weighted adjacency matrix of the entity relation graph. Finally, for the inference of entity relation type, considering the interaction between entities and relations, the entity span matrix and relation connection matrix are simultaneously fed into the GCN for integrated extraction of entities and relations. Our model is evaluated on the public NYT dataset, attaining a precision of 66.4%, a recall of 63.1%, and an F1 score of 64.7% for joint entity and relation extraction, significantly outperforming other approaches. Experiments demonstrate that the proposed model is helpful for inferring entities and relations, considering the interaction between entities and relations through the Attention mechanism and GCN.

An attention-based Bi-GRU-CapsNet model for hypernymy detection between compound entities

Detecting Hypernymy Relations Between Medical Compound Entities Using a Hybrid-Attention Based Bi-GRU-CapsNet Model.

An Entity Alignment Method Based on Graph Attention Network with Pre-classification

Self-attention-based BiGRU and capsule network for named entity recognition

A Method for Chinese Entity Relationship Extraction Based on Bi-GRU

BRsyn-Caps: Chinese Text Classification Using Capsule Network Based on Bert and Dependency Syntax

A Hybrid Method for Entity Hyponymy Acquisition in Chinese Complex Sentences.

Entity Synonym Discovery via Multipiece Bilateral Context Matching

An Attention-Based Model Using Character Composition of Entities in Chinese Relation Extraction

Bi-GRU Relation Extraction Model Based on Keywords Attention

Transductive Non-linear Learning for Chinese Hypernym Prediction

Attention-Based Capsule Networks with Dynamic Routing for Relation Extraction

Joint Self-Attention and Multi-Embeddings for Chinese Named Entity Recognition

GRU-SCANET: Unleashing the Power of GRU-based Sinusoidal CApture Network for Precision-driven Named Entity Recognition

Entity relation joint extraction model combining pointer network and attention mechanism based on relative position embedding

BioByGANS: biomedical named entity recognition by fusing contextual and syntactic features through graph attention network in node classification framework

Entity Recognition of Chinese Electronic Medical Record Based on Gated Graph Neural Network

Word Embedding Projection Models for Hypernymy Relation Prediction

Integrated Extraction of Entities and Relations via Attentive Graph Convolutional Networks

Relational Extraction from Biomedical Texts with Capsule Network and Hybrid Knowledge Graph Embeddings

An Attention-Based BiLSTM-CRF Model for Chinese Clinic Named Entity Recognition