Abstract:Medical Named Entity Recognition (NER) is a critical task in medical text processing. But medical documents exhibit high variability in terms of language usage, abbreviations, synonyms, misspellings, and typographical errors, so the precise extraction of named entities is challenging. Although large language models (LLMs) have shown good performance in medical knowledge extraction tasks in few-shot settings, their performance is difficult to fully leverage in supervised medical named entity recognition (NER) tasks. This is because NER is a sequence labeling task, while LLMs are more suitable for tasks such as text generation. Furthermore, the structured output of NER tasks leads to a performance loss when LLMs convert it into generative text. Therefore, it is a challenging problem to utilize LLMs to improve the accuracy of medical named entity recognition tasks. On this paper, we propose a method that integrates LLM knowledge to enhance the performance of medical NER models. Firstly, we improve the structure of the LLM model to make it more adaptable to NER tasks. Secondly, we adopt the LoRA method and incorporate Chinese vocabulary information into the model training. Finally, to fully utilize the fine-tuned LLM to enhance the medical NER model, we convert the output of the LLM into a knowledge concentration matrix and inject it into the NER model. We have verify the effectiveness of our new method on the CMeEE dataset. The results demonstrate that our method can efficiently fine-tune the LLM and improve its performance. Moreover, our method can also leverage the prior knowledge of the fine-tuned LLM to enhance the BERT-based medical NER model. In addition, our method demonstrates good generalization and can tackle entity recognition tasks in other domains. We validated the superiority of our approach on the resume-zh dataset.

MedNER: Enhanced Named Entity Recognition in Medical Corpus via Optimized Balanced and Deep Active Learning

Clinical Named Entity Recognition from Chinese Electronic Medical Records Based on Deep Learning Pretraining

Combination of Loss-Based Active Learning and Semi-Supervised learning for Recognizing Entities in Chinese Electronic Medical Records

A Knowledge-Enhanced Medical Named Entity Recognition Method that Integrates Pre-Trained Language Models

Named Entity Recognition In Chinese Electronic Medical Record Using Attention Mechanism

A Template-Driven Framework for Chinese Medical Named Entity Recognition

Language model based on deep learning network for biomedical named entity recognition

Nested Named Entity Recognition from Medical Texts: An Adaptive Shared Network Architecture with Attentive CRF

Medical named entity recognition of Chinese electronic medical records based on stacked Bidirectional Long Short-Term Memory

Dictionary Guided Attention Network for Named Entity Recognition in Chinese Emrs

A weakly supervised method for named entity recognition of Chinese electronic medical records

Exploiting the concept level feature for enhanced name entity recognition in Chinese EMRs

Improving the recall of biomedical named entity recognition with label re-correction and knowledge distillation

A dictionary-guided attention network for biomedical named entity recognition in Chinese electronic medical records

LLMs in Biomedicine: A study on clinical Named Entity Recognition

Deep learning for named entity recognition on Chinese electronic medical records: Combining deep transfer learning with multitask bi-directional LSTM RNN

Improving Biomedical Named Entity Recognition with Label Re-correction and Knowledge Distillation

Chinese Medical Named Entity Recognition using CRF-MT-Adapt and NER-MRC

Named Entity Recognition from Biomedical Texts Using a Fusion Attention-Based BiLSTM-CRF.