Abstract:Background: Entity relation extraction technology can be used to extract entities and relations from medical literature, and automatically establish professional mapping knowledge domains. The classical text classification model, convolutional neural networks for sentence classification (TEXTCNN), has been shown to have good classification performance, but also has a long-distance dependency problem, which is a common problem of convolutional neural networks (CNNs). Recurrent neural networks (RNN) address the long-distance dependency problem but cannot capture text features at a specific scale in the text. Methods: To solve these problems, this study sought to establish a model with a multi-scale convolutional recurrent neural network for Sentence Classification (TEXTCRNN) to address the deficiencies in the 2 neural network structures. In entity relation extraction, the entity pair is generally composed of a subject and an object, but as the subject in the entity pair of medical literature is always omitted, it is difficult to use this coding method to obtain general entity position information. Thus, we proposed a new coding method to obtain entity position information to re-establish the relationship between subject and object and complete the entity relation extraction. Results: By comparing the benchmark neural network model and 2 typical multi-scale TEXTCRNN models, the TEXTCRNN [bidirectional long- and short-term memory (BiLSTM)] and TEXTCRNN [double-layer stacking gated recurrent unit (GRU)], the results showed that the multi-scale CRNN model had the best F1 value performance, and the TEXTCRNN (double-layer stacking GRU) was more capable of entity relation classification when the same entity word did not belong to the same entity relation. Conclusions: The experimental results of the entity relation extraction from Pharmacopoeia of the People's Republic of China-Guidelines for Clinical Drug Use-Volume of Chemical Drugs and Biological Products showed that entity relation extraction could effectively proceed using the new labeling method. Additionally, compared to typical neural network models, including the TEXTCNN, GRU, and BiLSTM, the multi-scale convolutional recurrent neural network structure had advantages across several evaluation indicators.

Drug Specification Named Entity Recognition Base on BiLSTM-CRF Model

Clinical Named Entity Recognition from Chinese Electronic Medical Records Based on Deep Learning Pretraining

Research on medical named entity recognition based on DB-MA-BiLSTM-CRF

Named Entity Recognition of Medical Examination Reports Based on BiLSTM+CRF Model

Extraction of entity relations from Chinese medical literature based on multi-scale CRNN

Named Entity Extraction for Chinese Electronic Medical Records.

Legal Text Recognition Using LSTM-CRF Deep Learning Model

Language model based on deep learning network for biomedical named entity recognition

Named Entity Recognition from Chinese Adverse Drug Event Reports with Lexical Feature Based BiLSTM-CRF and Tri-Training

Unified neural architecture for drug, disease, and clinical entity recognition

Medical entity recognition and knowledge map relationship analysis of Chinese EMRs based on improved BiLSTM-CRF

Unified Neural Architecture for Drug, Disease and Clinical Entity Recognition

A New Data Representation Based on Training Data Characteristics to Extract Drug Named-Entity in Medical Text

Entity relation extraction from electronic medical records based on improved annotation rules and BiLSTM-CRF

Research on named entity recognition of adverse drug reactions based on NLP and deep learning

Medical Named Entity Recognition Fusing Part-of-Speech and Stroke Features

GNTeam at 2018 n2c2: Feature-augmented BiLSTM-CRF for drug-related entity recognition in hospital discharge summaries

An attention-based deep learning model for clinical named entity recognition of Chinese electronic medical records

Bi-LSTM-CRF Network for Clinical Event Extraction With Medical Knowledge Features

Long short-term memory RNN for biomedical named entity recognition

Chinese-Named Entity Recognition from Adverse Drug Event Records: Radical Embedding-Combined Dynamic Embedding–Based BERT in a Bidirectional Long Short-term Conditional Random Field (Bi-Lstm-crf) Model