Abstract:Fusing lexicon information into Chinese characters, which has normally a number of meanings, has been proven to be effective for Chinese Named Entity Recognition (NER). However, the existing approaches to incorporating a matched Chinese word into its composition characters only take the word as a whole (no subdivision or part), which failed to capture fine-grained correlation in word-character space and failed to make full use of lexicon information. Moreover, existing approaches use the fixed (static) weights between words and characters. This limits the performance of NER. Considering the fact that the same word-character pairs have different interactions in different contexts, the weights of matched word-character pairs should be dynamic rather than fixed. In this paper, we propose a Polymorphic Graph Attention Network (PGAT), aiming at capturing dynamic correlation between characters and matched words from multiple dimensions, to enhance the character representation. By obtaining matched words of characters from lexicon, we carefully map the word-character in four positions, which are B (begin), M (middle), E (end) and S (single word). The proposed semantic fusion unit based on Graph Attention Network (GAT) can dynamically modulate attention of matched words and characters in the four dimensions B, M, E, and S. Thus, it can explicitly capture fine-grained correlation between characters and matched words across each dimension. Experiments on four Chinese NER datasets show that PGAT outperforms the baseline models. It demonstrates the significance of the attention capture and fusion capabilities of the proposed polymorphic graph. Furthermore, PGAT is used in character representation layer, which makes it easier to be combined with pre-trained models like BERT and other sequence encoding models like CNN and Transformer.

PTWA: Pre-Training with Word Attention for Chinese Named Entity Recognition.

Multi-task Label-wise Transformer for Chinese Named Entity Recognition.

Named Entity Recognition Based on Pre-training Model and Multi-head Attention Mechanism

Exploiting Character-Word Fusion to Enhance Chinese Named Entity Recognition Combined with Multi-head Attention Mechanism

Pretraining Multi-modal Representations for Chinese NER Task with Cross-Modality Attention

Chinese Named Entity Recognition Based on BERT with Whole Word Masking

Exploiting Word Semantics to Enrich Character Representations of Chinese Pre-trained Models

A Novel Character-Word Fusion Chinese Named Entity Recognition Model Based on Attention Mechanism

DSWA: A Dilated Shift Window Attention Method for Chinese Named Entity Recognition (S).

Prompt-Based Word-Level Information Injection BERT for Chinese Named Entity Recognition

Chinese Named Entity Recognition with Fusion of Attention and Whole Word Masking

Chinese NER Using ALBERT and Multi-word Information.

Attention-Based Bi-LSTM for Chinese Named Entity Recognition.

Chinese NER Enhanced Based on Different Scale Pre-Training Models

Pre-Training with Whole Word Masking for Chinese BERT

A hybrid Transformer approach for Chinese NER with features augmentation

Chinese Named Entity Recognition Method Based on Multi-head Attention Enhancing Word Information

Polymorphic Graph Attention Network for Chinese NER

Lexicon-matched Word Injection for Chinese NER.

An Improved Chinese Named Entity Recognition Method with TB-LSTM-CRF

Chinese Characters and Pinyin: A Model with Two Parallel Feature Extractors for Chinese Entity Recognition