Abstract:Medical procedure entity normalization is an important task to realize medical information sharing at the semantic level; it faces main challenges such as variety and similarity in real-world practice. Although deep learning-based methods have been successfully applied to biomedical entity normalization, they often depend on traditional context-independent word embeddings, and there is minimal research on medical entity recognition in Chinese Regarding the entity normalization task as a sentence pair classification task, we applied a three-step framework to normalize Chinese medical procedure terms, and it consists of dataset construction, candidate concept generation and candidate concept ranking. For dataset construction, external knowledge base and easy data augmentation skills were used to increase the diversity of training samples. For candidate concept generation, we implemented the BM25 retrieval method based on integrating synonym knowledge of SNOMED CT and train data. For candidate concept ranking, we designed a stacking-BERT model, including the original BERT-based and Siamese-BERT ranking models, to capture the semantic information and choose the optimal mapping pairs by the stacking mechanism. In the training process, we also added the tricks of adversarial training to improve the learning ability of the model on small-scale training data. Based on the clinical entity normalization task dataset of the 5th China Health Information Processing Conference, our stacking-BERT model achieved an accuracy of 93.1%, which outperformed the single BERT models and other traditional deep learning models. In conclusion, this paper presents an effective method for Chinese medical procedure entity normalization and validation of different BERT-based models. In addition, we found that the tricks of adversarial training and data augmentation can effectively improve the effect of the deep learning model for small samples, which might provide some useful ideas for future research.

Enriching Pre-Trained Language Model with Multi-Task Learning and Context for Medical Concept Normalization

Deep Neural Models for Medical Concept Normalization in User-Generated Texts

Multi-Task Medical Concept Normalization Using Multi-View Convolutional Neural Network

Deep Convolutional Neural Network Based Medical Concept Normalization

Domain Adaptation Meets Zero-Shot Learning: an Annotation-Efficient Approach to Multi-Modality Medical Image Segmentation

Medical concept normalization in social media posts with recurrent neural networks

Biomedical Entity Normalization based on Pre-trained Model with Enhanced Information.

Unified Medical Language System resources improve sieve-based generation and Bidirectional Encoder Representations from Transformers (BERT)–based ranking for concept normalization

Medical Concept Normalization in User Generated Texts by Learning Target Concept Embeddings

CMCN: Chinese medical concept normalization using continual learning and knowledge-enhanced

A Neural Multi-Task Learning Framework to Jointly Model Medical Named Entity Recognition and Normalization

Stacking-BERT model for Chinese medical procedure entity normalization

Conceptualized Representation Learning for Chinese Biomedical Text Mining

Sequence Learning with RNNs for Medical Concept Normalization in User-Generated Texts

Chinese Medical Concept Normalization by Using Text and Comorbidity Network Embedding

SMedBERT: A Knowledge-Enhanced Pre-trained Language Model with Structured Semantics for Medical Text Mining

Exploring the In-context Learning Ability of Large Language Model for Biomedical Concept Linking

BERT-based Ranking for Biomedical Entity Normalization

Improving Biomedical Pretrained Language Models with Knowledge

Medical Concept Normalization in a Low-Resource Setting