Abstract:Clinical named entity recognition (CNER) is a fundamental step for many clinical Natural Language Processing (NLP) systems, which aims to recognize and classify clinical entities such as diseases, symptoms, exams, body parts and treatments in clinical free texts. In recent years, with the development of deep learning technology, deep neural networks (DNNs) have been widely used in Chinese clinical named entity recognition and many other clinical NLP tasks. However, these state-of-the-art models failed to make full use of the global information and multi-level semantic features in clinical texts. We design an improved character-level representation approach which integrates the character embedding and the character-label embedding to enhance the specificity and diversity of feature representations. Then, a multi-head self-attention based Bi-directional Long Short-Term Memory Conditional Random Field (MUSA-BiLSTM-CRF) model is proposed. By introducing the multi-head self-attention and combining a medical dictionary, the model can more effectively capture the weight relationships between characters and multi-level semantic feature information, which is expected to greatly improve the performance of Chinese clinical named entity recognition. We evaluate our model on two CCKS challenge (CCKS2017 Task 2 and CCKS2018 Task 1) benchmark datasets and the experimental results show that our proposed model achieves the best performance competing with the state-of-the-art DNN based methods.

A Two-Stage Bi-LSTM Model for Chinese Company Name Recognition.

Chinese named entity recognition in power domain based on Bi-LSTM-CRF

Attention-Based Bi-LSTM for Chinese Named Entity Recognition.

Innovative Deep Neural Network Modeling For Fine-Grained Chinese Entity Recognition

Chinese Named Entity Recognition with a Multi-Phase Model

A Method of Chinese Named Entity Recognition Based on CNN-BILSTM-CRF Model.

Chinese Named Entity Recognition with Character-Level BLSTM and Soft Attention Model

Chinese Organization Name Automatic Recognition Using Class-based Language Model

Automatic Recognition of Chinese Organization Name Based on Cascaded Conditional Random Fields

Hierarchical LSTM with char-subword-word tree-structure representation for Chinese named entity recognition

Chinese Named Entity Recognition Using Role Model.

An Attention-Based BiLSTM-CRF Model for Chinese Clinic Named Entity Recognition

Automatic Chinese name recognition based on web corpus analysis

Chinese Organization Name Recognition Based on Co-Training Algorithm

Chinese Address Named Entity Recognition Based on BERT-BiLSTM-ATT-CRF Model

Chinese Named Entity Recognition based on Multi-level Information Extraction

Chinese named entity recognition with a hybrid-statistical model

Chinese Named Entity Recognition Fusing Lexical and Syntactic Information.

Chinese Clinical Named Entity Recognition Via Multi-Head Self-Attention Based BiLSTM-CRF

Five-Stroke Based CNN-BiRNN-CRF Network for Chinese Named Entity Recognition.

A BERT-BiLSTM-CRF Model for Chinese Electronic Medical Records Named Entity Recognition