Abstract:To address the problem of poor entity recognition performance caused by the lack of Chinese annotation in clinical electronic medical records, this paper proposes a multi-medical entity recognition method F-MNER using a fusion technique combining BART, Bi-LSTM, and CRF. First, after cleaning, encoding, and segmenting the electronic medical records, the obtained semantic representations are dynamically fused using a bidirectional autoregressive transformer (BART) model. Then, sequential information is captured using a bidirectional long short-term memory (Bi-LSTM) network. Finally, the conditional random field (CRF) is used to decode and output multi-task entity recognition. Experiments are performed on the CCKS2019 dataset, with micro avg Precision , macro avg Recall , weighted avg Precision reaching 0.880, 0.887, and 0.883, and micro avg F1-score , macro avg F1-score , weighted avg F1-score reaching 0.875, 0.876, and 0.876 respectively. Compared with existing models, our method outperforms the existing literature in three evaluation metrics ( micro average , macro average , weighted average ) under the same dataset conditions. In the case of weighted average, the Precision , Recall , and F1-score are 19.64%, 15.67%, and 17.58% higher than the existing BERT-BiLSTM-CRF model respectively. Experiments are performed on the actual clinical dataset with our MF-MNER, the Precision , Recall , and F1-score are 0.638, 0.825, and 0.719 under the micro-avg evaluation mechanism. The Precision , Recall , and F1-score are 0.685, 0.800, and 0.733 under the macro-avg evaluation mechanism. The Precision , Recall , and F1-score are 0.647, 0.825, and 0.722 under the weighted avg evaluation mechanism. The above results show that our method MF-MNER can integrate the advantages of BART, Bi-LSTM, and CRF layers, significantly improving the performance of downstream named entity recognition tasks with a small amount of annotation, and achieving excellent performance in terms of recall score, which has certain practical significance. Source code and datasets to reproduce the results in this paper are available at https://github.com/xfwang1969/MF-MNER.

Combination of Loss-Based Active Learning and Semi-Supervised learning for Recognizing Entities in Chinese Electronic Medical Records

Clinical Named Entity Recognition from Chinese Electronic Medical Records Based on Deep Learning Pretraining

A weakly supervised method for named entity recognition of Chinese electronic medical records

Deep learning for named entity recognition on Chinese electronic medical records: Combining deep transfer learning with multitask bi-directional LSTM RNN

MedNER: Enhanced Named Entity Recognition in Medical Corpus via Optimized Balanced and Deep Active Learning

Semi-Supervised Noisy Label Learning for Chinese Clinical Named Entity Recognition

Chinese medical entity recognition based on the dual-branch TENER model

An attention-based deep learning model for clinical named entity recognition of Chinese electronic medical records

Chinese EMR Named Entity Recognition Using Fused Label Relations Based on Machine Reading Comprehension Framework

Research on Chinese medical named entity recognition based on collaborative cooperation of multiple neural network models

Named entity recognition of Chinese electronic medical records based on a hybrid neural network and medical MC-BERT

Multi-task learning for Chinese clinical named entity recognition with external knowledge

A multitask bi-directional RNN model for named entity recognition on Chinese electronic medical records

Recognition of Chinese Electronic Medical Records for Rehabilitation Robots: Information Fusion Classification Strategy

Chinese Medical Entity Recognition Model Based on Character and Word Vector Fusion

Named Entity Recognition for Chinese Electronic Medical Records Based on Multitask and Transfer Learning

Named entity recognition of Chinese electronic medical rec-ords based on adversarial training and feature fusion

A hybrid method based on semi-supervised learning for relation extraction in Chinese EMRs

MF-MNER: Multi-models Fusion for MNER in Chinese Clinical Electronic Medical Records

Chinese Medical Named Entity Recognition using CRF-MT-Adapt and NER-MRC