Abstract:Traditional named entity recognition (NER) methods derived from deep learning (DL) often ignore the long-distance syntactic dependence relationships between words. In such methods, the representation of Chinese word vectors is too simple to solve the problem of polysemy. To address these shortcomings, this paper proposes a syntactic dependency guided BERT-BiLSTM-GAM-CRF model for Chinese NER. First, the self-attention method guided by the dependency syntactic parsing tree is embedded in the transformer computing framework of the BERT model. This can not only obtain the deep two-way linguistic representation of a word according to the context information of the word, but it can also better express the long-distance syntactic dependency relationships between words; Second, the trained word vector sequence is input into the BiLSTM layer embedded in the global attention mechanism (GAM), and then the most important whole situation semantic information in the sentence is obtained. Finally, the CRF is employed to learn the dependence relationships between adjacent labels to obtain the best sentence level label sequence. A large number of experiments on the CLUENER-2020 corpus, MSRA corpus, Weibo corpus and OntoNotes4 corpus prove that the constructed model has good results for the Chinese NER task, and the F1 values are 81.08%, 94.97%, 63.60% and 75.64% respectively.

A NEW CHINESE DEPENDENCY ANALYSIS METHOD BASED ON SEQUENCE LABELING MODEL

Chinese Dependency Parsing Based on Treebank

A Chinese Dependency Syntax for Treebanking

Capturing Long-distance Dependencies in Sequence Models: A Case Study of Chinese Part-of-speech Tagging.

Classifying Syntactic Categories in the Chinese Dependency Network.

Chinese Syntactic and Typological Properties Based on Dependency Syntactic Treebanks

Neural Latent Dependency Model for Sequence Labeling

Theoretical probability of dependency structural trees

Using A Chinese Treebank to Measure Dependency Distance

Probability Distribution of Dependencies Based on A Chinese Dependency Treebank

Combining constituent and dependency syntactic views for Chinese semantic role labeling

Joint Segmentation and Tagging with Coupled Sequences Labeling

Universal Dependencies Parsing For Colloquial Singaporean English

A Chinese Text Paraphrase Detection Method Based on Dependency Tree.

A syntax and semantics linking algorithm for the chinese language

Dependency Based Chinese Sentence Realization

Data-driven, PCFG-based and Pseudo-PCFG-based Models for Chinese Dependency Parsing

Semantic Dependency Labeling Of Chinese Noun Phrases Based On Semantic Lexicon

A Pilot Study on Dialogue-Level Dependency Parsing for Chinese

Improve Chinese Semantic Dependency Parsing Via Syntactic Dependency Parsing

Dependency syntax guided BERT-BiLSTM-GAM-CRF for Chinese NER