Abstract:Background: Entity relation extraction technology can be used to extract entities and relations from medical literature, and automatically establish professional mapping knowledge domains. The classical text classification model, convolutional neural networks for sentence classification (TEXTCNN), has been shown to have good classification performance, but also has a long-distance dependency problem, which is a common problem of convolutional neural networks (CNNs). Recurrent neural networks (RNN) address the long-distance dependency problem but cannot capture text features at a specific scale in the text. Methods: To solve these problems, this study sought to establish a model with a multi-scale convolutional recurrent neural network for Sentence Classification (TEXTCRNN) to address the deficiencies in the 2 neural network structures. In entity relation extraction, the entity pair is generally composed of a subject and an object, but as the subject in the entity pair of medical literature is always omitted, it is difficult to use this coding method to obtain general entity position information. Thus, we proposed a new coding method to obtain entity position information to re-establish the relationship between subject and object and complete the entity relation extraction. Results: By comparing the benchmark neural network model and 2 typical multi-scale TEXTCRNN models, the TEXTCRNN [bidirectional long- and short-term memory (BiLSTM)] and TEXTCRNN [double-layer stacking gated recurrent unit (GRU)], the results showed that the multi-scale CRNN model had the best F1 value performance, and the TEXTCRNN (double-layer stacking GRU) was more capable of entity relation classification when the same entity word did not belong to the same entity relation. Conclusions: The experimental results of the entity relation extraction from Pharmacopoeia of the People's Republic of China-Guidelines for Clinical Drug Use-Volume of Chemical Drugs and Biological Products showed that entity relation extraction could effectively proceed using the new labeling method. Additionally, compared to typical neural network models, including the TEXTCNN, GRU, and BiLSTM, the multi-scale convolutional recurrent neural network structure had advantages across several evaluation indicators.

Recurrent neural networks with segment attention and entity description for relation extraction from clinical texts

Attention-based Deep Residual Learning Network for Entity Relation Extraction in Chinese EMRs

RECA: Relation Extraction Based on Cross-Attention Neural Network

Beyond Word Attention: Using Segment Attention in Neural Relation Extraction

A neural joint model for entity and relation extraction from biomedical text

Attention-Based Convolutional Neural Network for Semantic Relation Extraction.

Extraction of entity relations from Chinese medical literature based on multi-scale CRNN

Fine-tuning BERT for Joint Entity and Relation Extraction in Chinese Medical Text

End-to-End Neural Relation Extraction Using Deep Biaffine Attention

Entity-Aware Self-Attention and Contextualized GCN for Enhanced Relation Extraction in Long Sentences

Relation Extraction in Biomedical Texts: A Cross-Sentence Approach

Syntax-aware entity representations for neural relation extraction.

Joint extraction of entities and relations via an entity correlated attention neural model

Construction and Application of Text Entity Relation Joint Extraction Model Based on Multi-Head Attention Neural Network

Neural Relation Extraction with Multi-lingual Attention

Joint Model of Entity Recognition and Relation Extraction with Self-attention Mechanism

Enhanced Heterogeneous Graph Attention Network with a Novel Multilabel Focal Loss for Document-Level Relation Extraction

A Discrete Joint Model for Entity and Relation Extraction from Clinical Notes

Utilizing Entity-Based Gated Convolution and Multilevel Sentence Attention to Improve Distantly Supervised Relation Extraction

Distantly Supervised Neural Network Model For Relation Extraction

BAMRE: Joint extraction model of Chinese medical entities and relations based on Biaffine transformation with relation attention