Abstract:To address the problem of poor entity recognition performance caused by the lack of Chinese annotation in clinical electronic medical records, this paper proposes a multi-medical entity recognition method F-MNER using a fusion technique combining BART, Bi-LSTM, and CRF. First, after cleaning, encoding, and segmenting the electronic medical records, the obtained semantic representations are dynamically fused using a bidirectional autoregressive transformer (BART) model. Then, sequential information is captured using a bidirectional long short-term memory (Bi-LSTM) network. Finally, the conditional random field (CRF) is used to decode and output multi-task entity recognition. Experiments are performed on the CCKS2019 dataset, with micro avg Precision , macro avg Recall , weighted avg Precision reaching 0.880, 0.887, and 0.883, and micro avg F1-score , macro avg F1-score , weighted avg F1-score reaching 0.875, 0.876, and 0.876 respectively. Compared with existing models, our method outperforms the existing literature in three evaluation metrics ( micro average , macro average , weighted average ) under the same dataset conditions. In the case of weighted average, the Precision , Recall , and F1-score are 19.64%, 15.67%, and 17.58% higher than the existing BERT-BiLSTM-CRF model respectively. Experiments are performed on the actual clinical dataset with our MF-MNER, the Precision , Recall , and F1-score are 0.638, 0.825, and 0.719 under the micro-avg evaluation mechanism. The Precision , Recall , and F1-score are 0.685, 0.800, and 0.733 under the macro-avg evaluation mechanism. The Precision , Recall , and F1-score are 0.647, 0.825, and 0.722 under the weighted avg evaluation mechanism. The above results show that our method MF-MNER can integrate the advantages of BART, Bi-LSTM, and CRF layers, significantly improving the performance of downstream named entity recognition tasks with a small amount of annotation, and achieving excellent performance in terms of recall score, which has certain practical significance. Source code and datasets to reproduce the results in this paper are available at https://github.com/xfwang1969/MF-MNER.

Multi-modal Graph Fusion for Named Entity Recognition with Targeted Visual Guidance

Multimodal heterogeneous graph entity-level fusion for named entity recognition with multi-granularity visual guidance

GNN-Based Multimodal Named Entity Recognition

MVPN: Multi-granularity visual prompt-guided fusion network for multimodal named entity recognition

Multi-Grained Query-Guided Set Prediction Network for Grounded Multimodal Named Entity Recognition

A Multi-Task Framework Based on Decomposition for Multimodal Named Entity Recognition

Visual Clue Guidance and Consistency Matching Framework for Multimodal Named Entity Recognition

Learning from Different Text-Image Pairs: A Relation-enhanced Graph Convolutional Network for Multimodal NER

CAT-MNER: Multimodal Named Entity Recognition with Knowledge-Refined Cross-Modal Attention

Integrating Large Pre-trained Models into Multimodal Named Entity Recognition with Evidential Fusion

MLNet: a multi-level multimodal named entity recognition architecture

Multimodal Features Enhanced Named Entity Recognition Based on Self-Attention Mechanism.

MSFM: Multi-view Semantic Feature Fusion Model for Chinese Named Entity Recognition.

MNER-QG: An End-to-End MRC Framework for Multimodal Named Entity Recognition with Query Grounding

Dual-Gated Fusion with Prefix-Tuning for Multi-Modal Relation Extraction

MF-MNER: Multi-models Fusion for MNER in Chinese Clinical Electronic Medical Records

MAF - A General Matching and Alignment Framework for Multimodal Named Entity Recognition.

Multi-Modal Entity Alignment Method Based on Feature Enhancement

Multi-granularity cross-modal representation learning for named entity recognition on social media

MIFM: Multi-Granularity Information Fusion Model for Chinese Named Entity Recognition