Abstract:Medical procedure entity normalization is an important task to realize medical information sharing at the semantic level; it faces main challenges such as variety and similarity in real-world practice. Although deep learning-based methods have been successfully applied to biomedical entity normalization, they often depend on traditional context-independent word embeddings, and there is minimal research on medical entity recognition in Chinese Regarding the entity normalization task as a sentence pair classification task, we applied a three-step framework to normalize Chinese medical procedure terms, and it consists of dataset construction, candidate concept generation and candidate concept ranking. For dataset construction, external knowledge base and easy data augmentation skills were used to increase the diversity of training samples. For candidate concept generation, we implemented the BM25 retrieval method based on integrating synonym knowledge of SNOMED CT and train data. For candidate concept ranking, we designed a stacking-BERT model, including the original BERT-based and Siamese-BERT ranking models, to capture the semantic information and choose the optimal mapping pairs by the stacking mechanism. In the training process, we also added the tricks of adversarial training to improve the learning ability of the model on small-scale training data. Based on the clinical entity normalization task dataset of the 5th China Health Information Processing Conference, our stacking-BERT model achieved an accuracy of 93.1%, which outperformed the single BERT models and other traditional deep learning models. In conclusion, this paper presents an effective method for Chinese medical procedure entity normalization and validation of different BERT-based models. In addition, we found that the tricks of adversarial training and data augmentation can effectively improve the effect of the deep learning model for small samples, which might provide some useful ideas for future research.

Fancy Man Lauches Zippo at WNUT 2020 Shared Task-1: A Bert Case Model for Wet Lab Entity Extraction

A BERT-Based Named Entity Recognition Method of Warm Disease in Traditional Chinese Medicine

RETRACTED: an Entity Relationship Extraction Model Based on BERT-BLSTM-CRF for Food Safety Domain (retracted Article)

MMBERT: a unified framework for biomedical named entity recognition

WNUT-2020 Task 1 Overview: Extracting Entities and Relations from Wet Lab Protocols

Improve on Entity Recognition Method Based on BiLSTM-CRF Model for the Nuclear Technology Knowledge Graph

Stacking-BERT model for Chinese medical procedure entity normalization

Network Configuration Entity Extraction Method Based on Transformer with Multi-Head Attention Mechanism

Development of Biomedical Corpus Enlargement Platform Using BERT for Bio-entity Recognition

Named Entity Recognition of Chinese Crop Diseases and Pests Based on RoBERTa-wwm with Adversarial Training

Transfer Learning for Scientific Data Chain Extraction in Small Chemical Corpus with BERT-CRF Model

An Entity Relationship Extraction Model Based on BERT-BLSTM-CRF for Food Safety Domain

GRU-SCANET: Unleashing the Power of GRU-based Sinusoidal CApture Network for Precision-driven Named Entity Recognition

Named entity recognition model based on Multi‐BiLSTM and competition mechanism

DABC: A Named Entity Recognition Method Incorporating Attention Mechanisms

Ensemble pretrained language models to extract biomedical knowledge from literature

Chinese Named Entity Recognition Method in History and Culture Field Based on BERT

BERT-BIGRU-CRF: A Novel Entity Relationship Extraction Model

Named Entity Recognition of Electronic Medical Records based on BERT-BiLSTM-Biaffine Model

RoBERTa-wwm-ext Fine-Tuning for Chinese Text Classification