Abstract:Entity relationship extraction is one of the key areas of information extraction and is an important research content in the field of natural language processing. Based on past research, this paper proposes a combined extraction model based on a multi-headed attention neural network. Based on the BERT training model architecture, this paper extracts textual entities and relations tasks. At the same time, it integrates the naming entity feature, the terminology labeling characteristics, and the training relationship. The multi-attention mechanism and improved neural structures are added to the model to enhance the characteristic extraction capacity of the model. By studying the parameters of the multi-head attention mechanism, it is shown that the optimal parameters of the multi-head attention are h = 8, dv = 16, and the classification effect of the model is the best at this time. After experimental analysis, comparing the traditional text entity relationship extraction model and the multi-head attention neural network joint extraction model, the model entity relationship extraction effect was evaluated from the aspects of comprehensive evaluation index F1, accuracy rate P, and system time consumed. Experiments show: First, in the accuracy indicator, Xception performance is best, reaching 87.7%, indicating that the model extraction feature effect is enhanced. Second, with the increase of the number of iterative times, the verification set curve and the training set curve have increased to 96% and 98%, respectively, and the model has a strong generalization ability. Third, the model completes the extraction of all data in the test set in 1005 ms, which is an acceptable speed. Therefore, the model test results in this article are good, with a strong practical value.

Entity Relationship Extraction Based on BLSTM Model

Entity Relationship Extraction Based on Bi-LSTM and Attention Mechanism

Construction and Application of Text Entity Relation Joint Extraction Model Based on Multi-Head Attention Neural Network

A Novel Chinese Entity Relationship Extraction Method Based on the Bidirectional Maximum Entropy Markov Model

A neural network-based joint learning approach for biomedical entity and relation extraction from biomedical literature

Entity relation joint extraction model combining pointer network and attention mechanism based on relative position embedding

End-to-End Neural Relation Extraction Using Deep Biaffine Attention

Extracting Entities and Relations by an End-to-End Neural Model with Multi-Layer Encoder.

A Novel Relationship Extraction Scheme Based on Negative Feedback Attention

Recurrent neural networks with segment attention and entity description for relation extraction from clinical texts

BERT-BIGRU-CRF: A Novel Entity Relationship Extraction Model

Attention-Based Convolutional Neural Network for Semantic Relation Extraction.

Joint extraction of entities and relations via an entity correlated attention neural model

A neural joint model for entity and relation extraction from biomedical text

Character Relationship Extraction Method Based on BiLSTM

Attention-based Deep Residual Learning Network for Entity Relation Extraction in Chinese EMRs

A Method for Chinese Entity Relationship Extraction Based on Bi-GRU

An Internet Resource Extracting Relation Model based on Distant Supervision and Deep Learning

Entity relation extraction from electronic medical records based on improved annotation rules and BiLSTM-CRF

A Survey Deep Learning Based Relation Extraction