Abstract:Integrating lexical information into Chinese character embedding is a valid method to figure out the Chinese named entity recognition (NER) issue. However, most existing methods focus only on the discovery of named entity boundaries, considering only the words matched by the Chinese characters. They ignore the association between Chinese characters and their left and right matching words. They ignore the local semantic information of the character’s neighborhood, which is crucial for Chinese NER. The Chinese language incorporates a significant number of polysemous words, meaning that a single word can possess multiple meanings. Consequently, in the absence of sufficient contextual information, individuals may encounter difficulties in comprehending the intended meaning of a text, leading to the emergence of ambiguity. We consider how to handle the issue of entity ambiguity because of polysemous words in Chinese texts in different contexts more simply and effectively. We propose in this paper the use of graph attention networks to construct relatives among matching words and neighboring characters as well as matching words and adding left- and right-matching words directly using semantic information provided by the local lexicon. Moreover, this paper proposes a short-sequence convolutional neural network (SSCNN). It utilizes the generated shorter subsequence encoded with the sliding window module to enhance the perception of local information about the character. Compared with the widely used Chinese NER models, our approach achieves 1.18%, 0.29%, 0.18%, and 1.1% improvement on the four benchmark datasets Weibo, Resume, OntoNotes, and E-commerce, respectively, and proves the effectiveness of the model.

Combining Character and Word Information in Neural Machine Translation Using a Multi-Level Attention.

Attention-via-Attention Neural Machine Translation

Chinese Short Text Classification with Mutual-Attention Convolutional Neural Networks

Neural Machine Translation with Recurrent Attention Modeling

Learning When to Attend for Neural Machine Translation

Neural System Combination For Machine Translation

A Local Information Perception Enhancement–Based Method for Chinese NER

Neural Machine Translation of Logographic Languages Using Sub-character Level Information

Multi-channel Encoder for Neural Machine Translation

Effective Approaches to Attention-based Neural Machine Translation

Design of English Lexical Analysis System for Machine Translation Based on Multimodal Neural Network

Neural Machine Translation with Supervised Attention

Character-based Neural Machine Translation

Improving Multi-Head Attention with Capsule Networks

Multi-Granularity Self-Attention for Neural Machine Translation

Neural Machine Translation with Attention Based on a New Syntactic Branch Distance

Character-Level Translation with Self-attention

Alleviating the Inequality of Attention Heads for Neural Machine Translation

Self-Attention and Dynamic Convolution Hybrid Model for Neural Machine Translation

A Character-Aware Encoder for Neural Machine Translation.

Agreement-based Joint Training for Bidirectional Attention-based Neural Machine Translation.