Abstract:Entity relationship extraction is one of the key areas of information extraction and is an important research content in the field of natural language processing. Based on past research, this paper proposes a combined extraction model based on a multi-headed attention neural network. Based on the BERT training model architecture, this paper extracts textual entities and relations tasks. At the same time, it integrates the naming entity feature, the terminology labeling characteristics, and the training relationship. The multi-attention mechanism and improved neural structures are added to the model to enhance the characteristic extraction capacity of the model. By studying the parameters of the multi-head attention mechanism, it is shown that the optimal parameters of the multi-head attention are h = 8, dv = 16, and the classification effect of the model is the best at this time. After experimental analysis, comparing the traditional text entity relationship extraction model and the multi-head attention neural network joint extraction model, the model entity relationship extraction effect was evaluated from the aspects of comprehensive evaluation index F1, accuracy rate P, and system time consumed. Experiments show: First, in the accuracy indicator, Xception performance is best, reaching 87.7%, indicating that the model extraction feature effect is enhanced. Second, with the increase of the number of iterative times, the verification set curve and the training set curve have increased to 96% and 98%, respectively, and the model has a strong generalization ability. Third, the model completes the extraction of all data in the test set in 1005 ms, which is an acceptable speed. Therefore, the model test results in this article are good, with a strong practical value.

A Novel Relationship Extraction Scheme Based on Negative Feedback Attention

Entity Relationship Extraction Based on Bi-LSTM and Attention Mechanism

A Novel Chinese Entity Relationship Extraction Method Based on the Bidirectional Maximum Entropy Markov Model

Entity Relationship Extraction Based on BLSTM Model

Recurrent neural networks with segment attention and entity description for relation extraction from clinical texts

A relationship extraction method and system

Relation Extraction Based on Dual Attention Mechanism.

End-to-End Neural Relation Extraction Using Deep Biaffine Attention

Entity relation joint extraction model combining pointer network and attention mechanism based on relative position embedding

Construction and Application of Text Entity Relation Joint Extraction Model Based on Multi-Head Attention Neural Network

Bi-GRU Relation Extraction Model Based on Keywords Attention

Attention-Based Convolutional Neural Network for Semantic Relation Extraction.

Utilizing Entity-Based Gated Convolution and Multilevel Sentence Attention to Improve Distantly Supervised Relation Extraction

Hierarchical Attention Cnn And Entity-Aware For Relation Extraction

Entity-Aware Self-Attention and Contextualized GCN for Enhanced Relation Extraction in Long Sentences

Semantic Piecewise Convolutional Neural Network with Adaptive Negative Training for Distantly Supervised Relation Extraction

Research on entity relationship extraction for diabetes medical literature

Syntax-aware entity representations for neural relation extraction.

An Attention-Based Model Using Character Composition of Entities in Chinese Relation Extraction

A novel pipelined end-to-end relation extraction framework with entity mentions and contextual semantic representation

Extracting Entities and Relations by an End-to-End Neural Model with Multi-Layer Encoder.