Natural products containing a nitrogen-nitrogen bond.

Lachlan M. Blair,J. Sperry

DOI: https://doi.org/10.1021/np400124n

IF: 5.1

2013-04-11

Journal of Natural Products

Abstract:As of early 2013, over 200 natural products are known to contain a nitrogen-nitrogen (N-N) bond. This report categorizes these compounds by structural class and details their isolation and biological activity.

What problem does this paper attempt to address?

Clinical Named Entity Recognition from Chinese Electronic Medical Records Based on Deep Learning Pretraining

Lejun Gong,Zhifei Zhang,Shiqi Chen

DOI: https://doi.org/10.1155/2020/8829219

2020-01-01

Journal of Healthcare Engineering

Abstract:Background. Clinical named entity recognition is the basic task of mining electronic medical records text, which are with some challenges containing the language features of Chinese electronic medical records text with many compound entities, serious missing sentence components, and unclear entity boundary. Moreover, the corpus of Chinese electronic medical records is difficult to obtain. Methods. Aiming at these characteristics of Chinese electronic medical records, this study proposed a Chinese clinical entity recognition model based on deep learning pretraining. The model used word embedding from domain corpus and fine-tuning of entity recognition model pretrained by relevant corpus. Then BiLSTM and Transformer are, respectively, used as feature extractors to identify four types of clinical entities including diseases, symptoms, drugs, and operations from the text of Chinese electronic medical records. Results. 75.06% Macro-P, 76.40% Macro-R, and 75.72% Macro-F1 aiming at test dataset could be achieved. These experiments show that the Chinese clinical entity recognition model based on deep learning pretraining can effectively improve the recognition effect. Conclusions. These experiments show that the proposed Chinese clinical entity recognition model based on deep learning pretraining can effectively improve the recognition performance.
An attention-based deep learning model for clinical named entity recognition of Chinese electronic medical records

Luqi Li,Jie Zhao,Li Hou,Yunkai Zhai,Jinming Shi,Fangfang Cui

DOI: https://doi.org/10.1186/s12911-019-0933-6

IF: 3.298

2019-12-01

BMC Medical Informatics and Decision Making

Abstract:Abstract Background Clinical named entity recognition (CNER) is important for medical information mining and establishment of high-quality knowledge map. Due to the different text features from natural language and a large number of professional and uncommon clinical terms in Chinese electronic medical records (EMRs), there are still many difficulties in clinical named entity recognition of Chinese EMRs. It is of great importance to eliminate semantic interference and improve the ability of autonomous learning of internal features of the model under the small training corpus. Methods From the perspective of deep learning, we integrated the attention mechanism into neural network, and proposed an improved clinical named entity recognition method for Chinese electronic medical records called BiLSTM-Att-CRF, which could capture more useful information of the context and avoid the problem of missing information caused by long-distance factors. In addition, medical dictionaries and part-of-speech (POS) features were also introduced to improve the performance of the model. Results Based on China Conference on Knowledge Graph and Semantic Computing (CCKS) 2017 and 2018 Chinese EMRs corpus, our BiLSTM-Att-CRF model finally achieved better performance than other widely-used models without additional features(F1-measure of 85.4% in CCKS 2018, F1-measure of 90.29% in CCKS 2017), and achieved the best performance with POS and dictionary features (F1-measure of 86.11% in CCKS 2018, F1-measure of 90.48% in CCKS 2017). In particular, the BiLSTM-Att-CRF model had significant effect on the improvement of Recall. Conclusions Our work preliminarily confirmed the validity of attention mechanism in discovering key information and mining text features, which might provide useful ideas for future research in clinical named entity recognition of Chinese electronic medical records. In the future, we will explore the deeper application of attention mechanism in neural network.

medical informatics
Chinese Medical Entity Recognition Model Based on Character and Word Vector Fusion

Qinghui Zhang,Lei Hou,Pengtao Lv,Mengya Zhang,Hongwei Yang

DOI: https://doi.org/10.1155/2021/5933652

2021-11-24

Scientific Programming

Abstract:The medical information carried in electronic medical records has high clinical research value, and medical named entity recognition is the key to extracting valuable information from large-scale medical texts. At present, most of the studies on Chinese medical named entity recognition are based on character vector model or word vector model. Owing to the complexity and specificity of Chinese text, the existing methods may fail to achieve good performance. In this study, we propose a Chinese medical named entity recognition method that fuses character and word vectors. The method expresses Chinese texts as character vectors and word vectors separately and fuses them in the model for features. The proposed model can effectively avoid the problems of missing character vector information and inaccurate word vector partitioning. On the CCKS 2019 dataset for the named entity recognition task of Chinese electronic medical records, the proposed model achieves good performance and can effectively improve the accuracy of Chinese medical named entity recognition compared with other baseline models.

computer science, software engineering
A self-attention based neural architecture for Chinese medical named entity recognition

Qian Wan,Jie Liu,Luo Na Wei,Bin Ji

DOI: https://doi.org/10.3934/mbe.2020197

2020-05-09

Abstract:The combination of medical field and big data has led to an explosive growth in the volume of electronic medical records (EMRs), in which the information contained has guiding significance for diagnosis. And how to extract these information from EMRs has become a hot research topic. In this paper, we propose an ELMo-ET-CRF model based approach to extract medical named entity from Chinese electronic medical records (CEMRs). Firstly, a domain-specific ELMo model is fine-tuned on a common ELMo model with 4679 raw CEMRs. Then we use the encoder from Transformer (ET) as our model's encoder to alleviate the long context dependency problem, and the CRF is utilized as the decoder. At last, we compare the BiLSTM-CRF and ET-CRF model with word2vec and ELMo embeddings to CEMRs respectively to validate the effectiveness of ELMo-ET-CRF model. With the same training data and test data, the ELMo-ET-CRF outperforms all the other mentioned model architectures in this paper with 85.59% F1-score, which indicates the effectiveness of the proposed model architecture, and the performance is also competitive on the CCKS2019 leaderboard.
Exploiting the concept level feature for enhanced name entity recognition in Chinese EMRs

Qing Zhao,Dan Wang,Jianqiang Li,Faheem Akhtar

DOI: https://doi.org/10.1007/s11227-019-02917-3

IF: 3.3

2019-06-10

The Journal of Supercomputing

Abstract:The accumulation and explosive growth of the electronic medical records (EMRs) make the name entity recognition (NER) technologies become critical for the meaningful use of EMR data and then the practice of evidence-based medicine. The dominate NER approaches use the distributed representation of the words and characters to build deep learning-based NER models. However, for the task of biomedical named entity recognition, there are a large amount of complicated medical terminologies that are composed of multiple words. Splitting these terminologies to learn the word and character embeddings might cause semantic ambiguities. In this paper, we treat each medical terminology as a concept and propose a concept-enhanced named entity recognition model (CNER), where the features from three different granularities (i.e., concept, word, and character) are combined together for bio-NER. The extensive experiments are conducted on two real-world corpora: fully labeled corpus and partially labeled corpus. CNER achieves the highest F1 score (fully labeled corpus: precision = 88.23, recall = 88.29, and F1 = 88.26; partially labeled corpus: precision = 87.03, recall = 88.19, and F1 = 87.61) by outperforming the baseline CW-BLSTM-CRF approach for 0.58% and 1.15% respectively, which demonstrates the effectiveness of the proposed approach.
Research on Chinese medical named entity recognition based on collaborative cooperation of multiple neural network models

Bin Ji,Shasha Li,Jie Yu,Jun Ma,Jintao Tang,Qingbo Wu,Yusong Tan,Huijun Liu,Yun Ji

DOI: https://doi.org/10.1016/j.jbi.2020.103395

Abstract:Medical named entity recognition (NER) in Chinese electronic medical records (CEMRs) has drawn much research attention, and plays a vital prerequisite role for extracting high-value medical information. In 2018, China Health Information Processing Conference (CHIP2018) organized a medical NER academic competition aiming to extract three types of malignant tumor entity from CEMRs. Since the three types of entity are highly domain-specific and interdependency, extraction of them cannot be achieved with a single neural network model. Based on comprehensive study of the three types of entity and the entity interdependencies, we propose a collaborative cooperation of multiple neural network models based approach, which consists of two BiLSTM-CRF models and a CNN model. In order to tackle the problem that target scene dataset is small and entity distributions are sparse, we introduce non-target scene datasets and propose sentence-level neural network model transfer learning. Based on 30,000 real-world CEMRs, we pre-train medical domain-specific Chinese character embeddings with word2vec, GloVe and ELMo, and apply them to our approach respectively to validate effects of pre-trained language models in Chinese medical NER. Also, as control experiments, we apply Gated Recurrent Unit to our approach. Finally, our approach achieves an overall F1-score of 87.60%, which is the state-of-the-art performance to the best of our knowledge. In addition, our approach has won the champion of the medical NER academic competition organized by 2019 China Conference on Knowledge Graph and Semantic Computing, which proves the outstanding generalization ability of our approach.
Chinese Medical Named Entity Recognition Based on Fusion of Global Features and Multi-Local Features

Huarong Sun,Jianfeng Wang,Bo Li,Xiyuan Cao,Junbin Zang,Chenyang Xue,Zhidong Zhang

DOI: https://doi.org/10.1109/access.2023.3339610

IF: 3.9

2023-12-20

IEEE Access

Abstract:Chinese medical Named Entity Recognition (NER) is a task of Natural Language Processing (NLP), which aims to extract key information from Chinese medical texts. Recently, Transformer becomes the mainstream approach for NLP due to its powerful capability for global feature extraction. However, entities usually appear in the form of subsequences in NER, therefore the local features are not negligible, and the uncertainty of Chinese word segmentation increases the difficulty of this task. In this paper, we propose a network structure that combines global feature extraction and multi-local feature extraction to enhance the performance of Chinese medical NER. Based on the global feature extracted by the Transformer, Bi-LSTM is used to extract the multi-local features, and a context integration mechanism is used to enhance local features by integrating both forward and backward global contexts in each cell. This allows for a more comprehensive representation of individual cells. And a feature fusion method based on attention mechanism is proposed, which allows the decoder to better focus on the more important information for predicting the current character. During the global feature extraction, the flat-lattice structure is introduced to generate all the potential results of Chinese word segmentation. And the span-based relative positional encoding integrates direction and distance perception, which overcomes the shortcoming of Transformer's inability to capture sequential characteristics. Finally, a CRF with conditional constraints is used as the decoder of the model. Experimental results on two benchmark datasets show the effectiveness of our model, and the method significantly outperforms the state-of-the-art methods in the medical NER task, achieving value of 93.64% on CCKS2017 and 85.01% on CCKS2019.

computer science, information systems,telecommunications,engineering, electrical & electronic
Cirrhosis of the liver. A study of 84 cases with emphasis on the clinical, biochemical and radiological aspects.

M. Viswanathan

1966-09-16

Abstract:
A weakly supervised method for named entity recognition of Chinese electronic medical records

Meng Li,Chunrong Gao,Kuang Zhang,Huajian Zhou,Jing Ying

DOI: https://doi.org/10.1007/s11517-023-02871-6

2023-07-15

Medical & Biological Engineering & Computing

Abstract:The field of Chinese medical natural language processing faces a significant challenge in training accurate entity recognition models due to the limited availability of high-quality labeled data. In response, we propose a joint training model, MCBERT-GCN-CRF, which achieves high performance in identifying medical-related entities in Chinese electronic medical records. Additionally, we introduce CM-NER, a 5-step framework that effectively mitigates the effects of noise in weakly labeled data and establishes a principled connection between supervised and weakly supervised named entity recognition. We demonstrate significant improvements in recall rate and accuracy. Our approach outperforms traditional fully supervised pre-training models and other state-of-the-art methods by suppressing noise in weakly labeled data. Our proposed framework achieves an F1 score of 86.29% on the CCKS-2019 dataset, significantly higher than pre-trained model baselines ranging from 74.17 to 83.06%, and higher than the top-performing named entity recognition supervised learning models in the CCKS-2019 competition. Our results demonstrate the effectiveness of our proposed framework and highlight the potential of leveraging unlabeled data to train accurate models for named entity recognition in Chinese medical natural language processing. This research has significant implications for advancing natural language processing techniques in the medical domain and improving patient care.Graphical Abstract

engineering, biomedical,computer science, interdisciplinary applications,mathematical & computational biology,medical informatics
Named Entity Recognition in Chinese Electronic Medical Records Based on CRF.

Kaixin Liu,Qingcheng Hu,Jianwei Liu,Chunxiao Xing

DOI: https://doi.org/10.1109/wisa.2017.8

2017-01-01

Abstract:Massive Electronic Medical Records (EMRs) contain a lot of knowledge and Named Entity Recognition (NER) in Chinese EMR is a very important task. However, due to the lack of Chinese medical dictionary, there are few studies on NER in Chinese EMR. In this paper, we first build a medical dictionary. We then investigated the effects of different types of features in Chinese clinical NER tasks based on Condition Random Fields (CRF) algorithm, the most popular algorithm for NER, including bag-of-characters, part of speech, dictionary feature, and word clustering features. In the experimental section, we randomly selected 220 clinical texts from Peking Anzhen Hospital. The experimental results showed that these features were beneficial in varying degrees to Chinese named entity recognition. Finally, after analyzing the experimental results, we get some rules of thumb.
Medical entity recognition and knowledge map relationship analysis of Chinese EMRs based on improved BiLSTM-CRF

Jia Ke,Weiji Wang,Xiaojun Chen,Jianping Gou,Yan Gao,Shuai Jin

DOI: https://doi.org/10.1016/j.compeleceng.2023.108709

2023-05-01

Abstract:With the development of medical informatization, a large number of patients’ electronic medical records (EMRs) have been accumulated in the hospital information system, which is characterized by multi-structured data form, diversified professional vocabulary categories and fuzzy vocabulary demarcation. Natural language processing (NLP) provides a silver lining for parsing electronic medical records, and the mainstream methods include dictionary-based methods, rule-based and statistical methods, and machine learning methods. Due to the semantic richness and structural diversity of Chinese text, Chinese EMRs analysis methods are still scarce compared with English EMRs. In order to overcome the problems of unstructured, multiple meanings of words and unclear word boundaries in text of Chinese electronic medical records, this paper proposes a medical entity recognition method based on RoFormerV 2 -BiLSTM-CRF fusion model, using BIO annotation method to annotate the recognized medical entities, and using knowledge graph to analyze the medical entity relationships identified in single patient medical record, multiple patient medical records respectively. The relationships between the medical entities identified in a single patient record and multiple patient records are analyzed using knowledge graphs. The experimental analysis was conducted on the expert-annotated dataset CCKS2019, and the results showed that the proposed method was effective for recognizing “Diseases and Diagnoses”, “Laboratory Tests”, “Imaging Examinations”, “Anatomical Sites”, “Drugs” and “Surgery” in the dataset. The average accuracy, recall and F 1 -Score of the proposed method for the identification of the six medical entities, are 84.8%, 83.5% and 83.9%, respectively, which were 5.3%, 8.6% and 6.8% higher than the traditional Word2Vec-BiLSTM-CRF model, and the existing Word2Vec-BiLSTM-CRF and BERT-BiLSTM-CRF models were iteratively trained with the same evaluation. The experimental results show that the proposed model performs better in medical entity recognition.

engineering, electrical & electronic,computer science, interdisciplinary applications, hardware & architecture
Chinese medical entity recognition based on the dual-branch TENER model

Hui Peng,Zhichang Zhang,Dan Liu,Xiaohui Qin

DOI: https://doi.org/10.1186/s12911-023-02243-y

IF: 3.298

2023-07-26

BMC Medical Informatics and Decision Making

Abstract:Named Entity Recognition (NER) is a long-standing fundamental problem in various research fields of Natural Language Processing (NLP) and has been practiced in many application scenarios. However, the application results of NER methods in Chinese electronic medical records (EMRs) are not satisfactory, mainly due to the following two problems: (1) Existing methods do not take into account the impact of medical terminology on model recognition performance, resulting in poor model performance. (2) Existing methods do not fully utilize the Chinese language features contained in EMR, resulting in poor model robustness. Therefore, it is imminent to solve these two problems regarding the performance of the NER model for EMRs.

medical informatics
Fast and Accurate Recognition of Chinese Clinical Named Entities with Residual Dilated Convolutions

Jiahui Qiu,Qi Wang,Yangming Zhou,Tong Ruan,Ju Gao

DOI: https://doi.org/10.48550/arXiv.1808.08669

2018-11-27

Abstract:Clinical Named Entity Recognition (CNER) aims to identify and classify clinical terms such as diseases, symptoms, treatments, exams, and body parts in electronic health records, which is a fundamental and crucial task for clinical and translation research. In recent years, deep learning methods have achieved significant success in CNER tasks. However, these methods depend greatly on Recurrent Neural Networks (RNNs), which maintain a vector of hidden activations that are propagated through time, thus causing too much time to train models. In this paper, we propose a Residual Dilated Convolutional Neural Network with Conditional Random Field (RD-CNN-CRF) to solve it. Specifically, Chinese characters and dictionary features are first projected into dense vector representations, then they are fed into the residual dilated convolutional neural network to capture contextual features. Finally, a conditional random field is employed to capture dependencies between neighboring tags. Computational results on the CCKS-2017 Task 2 benchmark dataset show that our proposed RD-CNN-CRF method competes favorably with state-of-the-art RNN-based methods both in terms of computational performance and training time.

Computation and Language
Improving the Named Entity Recognition of Chinese Electronic Medical Records by Combining Domain Dictionary and Rules

Xianglong Chen,Chunping Ouyang,Yongbin Liu,Yi Bu

DOI: https://doi.org/10.3390/ijerph17082687

IF: 4.614

2020-01-01

International Journal of Environmental Research and Public Health

Abstract:Electronic medical records are an integral part of medical texts. Entity recognition of electronic medical records has triggered many studies that propose many entity extraction methods. In this paper, an entity extraction model is proposed to extract entities from Chinese Electronic Medical Records (CEMR). In the input layer of the model, we use word embedding and dictionary features embedding as input vectors, where word embedding consists of a character representation and a word representation. Then, the input vectors are fed to the bidirectional long short-term memory to capture contextual features. Finally, a conditional random field is employed to capture dependencies between neighboring tags. We performed experiments on body classification task, and the F1 values reached 90.65%. We also performed experiments on anatomic region recognition task, and the F1 values reached 93.89%. On both tasks, our model had higher performance than state-of-the-art models, such as Bi-LSTM-CRF, Bi-LSTM-Attention, and Vote. Through experiments, our model has a good effect when dealing with small frequency entities and unknown entities; with a small training dataset, our method showed 2-4% improvement on F1 value compared to the basic Bi-LSTM-CRF models. Additionally, on anatomic region recognition task, besides using our proposed entity extraction model, 12 rules we designed and domain dictionary were adopted. Then, in this task, the weighted F1 value of the three specific entities extraction reached 84.36%.
Medical Knowledge Attention Enhanced Neural Model for Named Entity Recognition in Chinese EMR.

Zhichang Zhang,Yu Zhang,Tong Zhou

DOI: https://doi.org/10.1007/978-3-030-01716-3_31

2018-01-01

Abstract:Named entity recognition (NER) in Chinese electronic medical records (EMRs) has become an important task of clinical natural language processing (NLP). However, limited studies have been performed on the clinical NER study in Chinese EMRs. Furthermore, when end-to-end neural network models have improved clinical NER performance, medical knowledge dictionaries such as various disease association dictionaries, which provide rich information of medical entities and relations among them, are rarely utilized in NER model. In this study, we investigate the problem of NER in Chinese EMRs and propose a clinical neural network NER model enhanced with medical knowledge attention by combining the entity mention information contained in external medical knowledge bases with EMR context together. Experimental results on the manually labeled dataset demonstrated that the proposed method can achieve better performance than the previous methods in most cases.
Multi-Label Classification in Patient-Doctor Dialogues With the RoBERTa-WWM-ext + CNN (Robustly Optimized Bidirectional Encoder Representations From Transformers Pretraining Approach With Whole Word Masking Extended Combining a Convolutional Neural Network) Model: Named Entity Study

Yuanyuan Sun,Dongping Gao,Xifeng Shen,Meiting Li,Jiale Nan,Weining Zhang

DOI: https://doi.org/10.2196/35606

2022-04-21

Abstract:Background: With the prevalence of online consultation, many patient-doctor dialogues have accumulated, which, in an authentic language environment, are of significant value to the research and development of intelligent question answering and automated triage in recent natural language processing studies. Objective: The purpose of this study was to design a front-end task module for the network inquiry of intelligent medical services. Through the study of automatic labeling of real doctor-patient dialogue text on the internet, a method of identifying the negative and positive entities of dialogues with higher accuracy has been explored. Methods: The data set used for this study was from the Spring Rain Doctor internet online consultation, which was downloaded from the official data set of Alibaba Tianchi Lab. We proposed a composite abutting joint model, which was able to automatically classify the types of clinical finding entities into the following 4 attributes: positive, negative, other, and empty. We adapted a downstream architecture in Chinese Robustly Optimized Bidirectional Encoder Representations from Transformers Pretraining Approach (RoBERTa) with whole word masking (WWM) extended (RoBERTa-WWM-ext) combining a text convolutional neural network (CNN). We used RoBERTa-WWM-ext to express sentence semantics as a text vector and then extracted the local features of the sentence through the CNN, which was our new fusion model. To verify its knowledge learning ability, we chose Enhanced Representation through Knowledge Integration (ERNIE), original Bidirectional Encoder Representations from Transformers (BERT), and Chinese BERT with WWM to perform the same task, and then compared the results. Precision, recall, and macro-F1 were used to evaluate the performance of the methods. Results: We found that the ERNIE model, which was trained with a large Chinese corpus, had a total score (macro-F1) of 65.78290014, while BERT and BERT-WWM had scores of 53.18247117 and 69.2795315, respectively. Our composite abutting joint model (RoBERTa-WWM-ext + CNN) had a macro-F1 value of 70.55936311, showing that our model outperformed the other models in the task. Conclusions: The accuracy of the original model can be greatly improved by giving priority to WWM and replacing the word-based mask with unit to classify and label medical entities. Better results can be obtained by effectively optimizing the downstream tasks of the model and the integration of multiple models later on. The study findings contribute to the translation of online consultation information into machine-readable information.
Named entity recognition of Chinese electronic medical records based on a hybrid neural network and medical MC-BERT

Peng Chen,Meng Zhang,Xiaosheng Yu,Songpu Li

DOI: https://doi.org/10.1186/s12911-022-02059-2

IF: 3.298

2022-12-04

BMC Medical Informatics and Decision Making

Abstract:Named entity recognition (NER) of electronic medical records is an important task in clinical medical research. Although deep learning combined with pretraining models performs well in recognizing entities in clinical texts, because Chinese electronic medical records have a special text structure and vocabulary distribution, general pretraining models cannot effectively incorporate entities and medical domain knowledge into representation learning; separate deep network models lack the ability to fully extract rich features in complex texts, which negatively affects the named entity recognition of electronic medical records.

medical informatics
Named entity recognition of Chinese electronic medical rec-ords based on adversarial training and feature fusion

Dequan Zheng,Feng Yu,Haoyu Zhang

DOI: https://doi.org/10.1145/3632971.3632983

2023-07-07

Abstract:Abstract. In the discipline of natural language processing, named entity recognition is the foundation for tasks such as information extraction, information retrieval, and knowledge graphs. This paper puts forward an entity recognition model based on adversarial training and feature fusion to address the issues of polysemy and not complete word recognition in Chinese electronic medical record named entity recognition. The above technique results in adversarial samples by infusing disturbance factors into the word embedding layer. These adversarial samples obtained are subsequently used for iterative training in order to optimize the model's parameters. Then, utilize the improved Transform encoder and Bi-GRU to extract global the field of semantics and direction information, add an attention mechanism to merge the extracted context features, and finally implement the entity labelling sequence using CRF. In addition, we use the RoBERTa-WWM pre-training model as the embedding layer of the model in order to offer character-level embedding, picking up more contextual semantic data as well as lexical information, as well as enhance entity recognition performance. Experimental results on the CCKS2017 and CCKS2019 evaluation datasets indicate that the proposed model outperforms the baseline model by 0.9% and 0.74 %, for example, in terms of F1. And comparative experiments demonstrate that the addition of adversarial training and feature fusion will improve the model's predictive ability and robustness.

Medicine,Computer Science
Named Entity Recognition in Chinese Medical Literature Using Pretraining Models

Yu Wang,Yining Sun,Zuchang Ma,Lisheng Gao,Yang Xu

DOI: https://doi.org/10.1155/2020/8812754

2020-09-09

Scientific Programming

Abstract:The medical literature contains valuable knowledge, such as the clinical symptoms, diagnosis, and treatments of a particular disease. Named Entity Recognition (NER) is the initial step in extracting this knowledge from unstructured text and presenting it as a Knowledge Graph (KG). However, the previous approaches of NER have often suffered from small-scale human-labelled training data. Furthermore, extracting knowledge from Chinese medical literature is a more complex task because there is no segmentation between Chinese characters. Recently, the pretraining models, which obtain representations with the prior semantic knowledge on large-scale unlabelled corpora, have achieved state-of-the-art results for a wide variety of Natural Language Processing (NLP) tasks. However, the capabilities of pretraining models have not been fully exploited, and applications of other pretraining models except BERT in specific domains, such as NER in Chinese medical literature, are also of interest. In this paper, we enhance the performance of NER in Chinese medical literature using pretraining models. First, we propose a method of data augmentation by replacing the words in the training set with synonyms through the Mask Language Model (MLM), which is a pretraining task. Then, we consider NER as the downstream task of the pretraining model and transfer the prior semantic knowledge obtained during pretraining to it. Finally, we conduct experiments to compare the performances of six pretraining models (BERT, BERT-WWM, BERT-WWM-EXT, ERNIE, ERNIE-tiny, and RoBERTa) in recognizing named entities from Chinese medical literature. The effects of feature extraction and fine-tuning, as well as different downstream model structures, are also explored. Experimental results demonstrate that the method of data augmentation we proposed can obtain meaningful improvements in the performance of recognition. Besides, RoBERTa-CRF achieves the highest F 1-score compared with the previous methods and other pretraining models.

computer science, software engineering
IMPROVING CHINESE MEDICAL NAMED ENTITY RECOGNITION USING GLYPH AND LEXICON

SHANHAO ZHONG,QINGSONG YU

DOI: https://doi.org/10.12783/dtssehs/aeim2021/35969

2021-03-29

Abstract:Abstract. Medical named entity recognition is the first step in processing electronic medical records. It is the basis for processing medical natural language text information into medical structured information, which has extremely high research value and application value. In this paper, we have proposed a model that aims to identify various types of named entities such as disease, imaging examination, laboratory examination, operation, drug, and anatomy from Chinese electronic medical record. We construct a fusion Glyph and lexicon model based on BERT. Experimental studies have shown that increasing character-level semantic representation can improve the performance of named entity recognition. In order to boost it, the major measures of our model include: (1) a CNN structure is proposed to capture glyph information. (2) Soft-Lexicon method is introduced to encode lexicon information. Our models show an improvement over the baseline BERT-BiLSTM-CRF model. The experimental results on CCKS2019 dataset showed that the F1 score was 84.64, which was +1.99 higher than the baseline level.

Natural products containing a nitrogen-nitrogen bond.

Clinical Named Entity Recognition from Chinese Electronic Medical Records Based on Deep Learning Pretraining

An attention-based deep learning model for clinical named entity recognition of Chinese electronic medical records

Chinese Medical Entity Recognition Model Based on Character and Word Vector Fusion

A self-attention based neural architecture for Chinese medical named entity recognition

Exploiting the concept level feature for enhanced name entity recognition in Chinese EMRs

Research on Chinese medical named entity recognition based on collaborative cooperation of multiple neural network models

Chinese Medical Named Entity Recognition Based on Fusion of Global Features and Multi-Local Features

Cirrhosis of the liver. A study of 84 cases with emphasis on the clinical, biochemical and radiological aspects.

A weakly supervised method for named entity recognition of Chinese electronic medical records

Named Entity Recognition in Chinese Electronic Medical Records Based on CRF.

Medical entity recognition and knowledge map relationship analysis of Chinese EMRs based on improved BiLSTM-CRF

Chinese medical entity recognition based on the dual-branch TENER model

Fast and Accurate Recognition of Chinese Clinical Named Entities with Residual Dilated Convolutions

Improving the Named Entity Recognition of Chinese Electronic Medical Records by Combining Domain Dictionary and Rules

Medical Knowledge Attention Enhanced Neural Model for Named Entity Recognition in Chinese EMR.

Multi-Label Classification in Patient-Doctor Dialogues With the RoBERTa-WWM-ext + CNN (Robustly Optimized Bidirectional Encoder Representations From Transformers Pretraining Approach With Whole Word Masking Extended Combining a Convolutional Neural Network) Model: Named Entity Study

Named entity recognition of Chinese electronic medical records based on a hybrid neural network and medical MC-BERT

Named entity recognition of Chinese electronic medical rec-ords based on adversarial training and feature fusion

Named Entity Recognition in Chinese Medical Literature Using Pretraining Models

IMPROVING CHINESE MEDICAL NAMED ENTITY RECOGNITION USING GLYPH AND LEXICON