Abstract:Chinese medical Named Entity Recognition (NER) is a task of Natural Language Processing (NLP), which aims to extract key information from Chinese medical texts. Recently, Transformer becomes the mainstream approach for NLP due to its powerful capability for global feature extraction. However, entities usually appear in the form of subsequences in NER, therefore the local features are not negligible, and the uncertainty of Chinese word segmentation increases the difficulty of this task. In this paper, we propose a network structure that combines global feature extraction and multi-local feature extraction to enhance the performance of Chinese medical NER. Based on the global feature extracted by the Transformer, Bi-LSTM is used to extract the multi-local features, and a context integration mechanism is used to enhance local features by integrating both forward and backward global contexts in each cell. This allows for a more comprehensive representation of individual cells. And a feature fusion method based on attention mechanism is proposed, which allows the decoder to better focus on the more important information for predicting the current character. During the global feature extraction, the flat-lattice structure is introduced to generate all the potential results of Chinese word segmentation. And the span-based relative positional encoding integrates direction and distance perception, which overcomes the shortcoming of Transformer's inability to capture sequential characteristics. Finally, a CRF with conditional constraints is used as the decoder of the model. Experimental results on two benchmark datasets show the effectiveness of our model, and the method significantly outperforms the state-of-the-art methods in the medical NER task, achieving value of 93.64% on CCKS2017 and 85.01% on CCKS2019.

Chinese NER Using Multi-View Transformer

Chinese Text Classification Using BERT and Flat-Lattice Transformer.

FLAT: Chinese NER Using Flat-Lattice Transformer

NFLAT: Non-Flat-Lattice Transformer for Chinese Named Entity Recognition

Disentangling 3D/4D Facial Affect Recognition with Faster Multi-View Transformer

MECT: Multi-Metadata Embedding based Cross-Transformer for Chinese Named Entity Recognition

A hybrid Transformer approach for Chinese NER with features augmentation

Constituent Attention for Vision Transformers

Porous Lattice-based Transformer Encoder for Chinese NER

Dynamic Multi-View Fusion Mechanism For Chinese Relation Extraction

MCL: Multi-Granularity Contrastive Learning Framework for Chinese NER

KCB-FLAT: Enhancing Chinese Named Entity Recognition with Syntactic Information and Boundary Smoothing Techniques

Multi-Unit Transformers for Neural Machine Translation

MViT: Mask Vision Transformer for Facial Expression Recognition in the Wild

Multi-task Transformer with Relation-attention and Type-attention for Named Entity Recognition

ERNIE-mmLayout: Multi-grained MultiModal Transformer for Document Understanding

Well-Behaved Transformer for Chinese Medical NER

MSFM: Multi-view Semantic Feature Fusion Model for Chinese Named Entity Recognition.

Chinese Medical Named Entity Recognition Based on Fusion of Global Features and Multi-Local Features

MAFormer: A transformer network with multi-scale attention fusion for visual recognition