Abstract:Traditional named entity recognition (NER) methods derived from deep learning (DL) often ignore the long-distance syntactic dependence relationships between words. In such methods, the representation of Chinese word vectors is too simple to solve the problem of polysemy. To address these shortcomings, this paper proposes a syntactic dependency guided BERT-BiLSTM-GAM-CRF model for Chinese NER. First, the self-attention method guided by the dependency syntactic parsing tree is embedded in the transformer computing framework of the BERT model. This can not only obtain the deep two-way linguistic representation of a word according to the context information of the word, but it can also better express the long-distance syntactic dependency relationships between words; Second, the trained word vector sequence is input into the BiLSTM layer embedded in the global attention mechanism (GAM), and then the most important whole situation semantic information in the sentence is obtained. Finally, the CRF is employed to learn the dependence relationships between adjacent labels to obtain the best sentence level label sequence. A large number of experiments on the CLUENER-2020 corpus, MSRA corpus, Weibo corpus and OntoNotes4 corpus prove that the constructed model has good results for the Chinese NER task, and the F1 values are 81.08%, 94.97%, 63.60% and 75.64% respectively.

Research on Bilingual Dependency Relationship Mapping for Chinese-English Lexicon Construction

An Empirical Study of Bilingual Conceptual Mapping Between Chinese and English

Building a bilingual WordNet-like lexicon: the new approach and algorithms

On Construction of a Chinese Corpus Bused on Semantic Dependency Relations

Enhancing Semantic Representations of Bilingual Word Embeddings with Syntactic Dependencies

A Chinese Dependency Syntax for Treebanking

Dependency syntax guided BERT-BiLSTM-GAM-CRF for Chinese NER

Character-Level Chinese Dependency Parsing via Modeling Latent Intra-Word Structure

Classifying Syntactic Categories in the Chinese Dependency Network.

Study on the Construction of CCD

Chinese Semantic Dependency Relation System and Treebank Construction.

Improve Discourse Dependency Parsing with Contextualized Representations

Using A Chinese Treebank to Measure Dependency Distance

Exploring Chinese and English Discourse Dependency Treebanks

Improving Chinese Dependency Parsing with Lexical Semantic Features

Universal Dependencies Parsing For Colloquial Singaporean English

The properties of rare and complex syntactic constructions in English. A corpus-based comparative study

A Unified Model for Joint Chinese Word Segmentation and Dependency Parsing

Cross-Lingual Dependency Parsing Using Code-Mixed TreeBank

The Construction of a Semantic Network of Chinese Lexical Associations Based on Large-Scale Corpora

Constructing a WordNet-Based Multilingual Lexical-semantic Net:A Semi-automatic Method