Abstract:Integrating lexical information into Chinese character embedding is a valid method to figure out the Chinese named entity recognition (NER) issue. However, most existing methods focus only on the discovery of named entity boundaries, considering only the words matched by the Chinese characters. They ignore the association between Chinese characters and their left and right matching words. They ignore the local semantic information of the character’s neighborhood, which is crucial for Chinese NER. The Chinese language incorporates a significant number of polysemous words, meaning that a single word can possess multiple meanings. Consequently, in the absence of sufficient contextual information, individuals may encounter difficulties in comprehending the intended meaning of a text, leading to the emergence of ambiguity. We consider how to handle the issue of entity ambiguity because of polysemous words in Chinese texts in different contexts more simply and effectively. We propose in this paper the use of graph attention networks to construct relatives among matching words and neighboring characters as well as matching words and adding left- and right-matching words directly using semantic information provided by the local lexicon. Moreover, this paper proposes a short-sequence convolutional neural network (SSCNN). It utilizes the generated shorter subsequence encoded with the sliding window module to enhance the perception of local information about the character. Compared with the widely used Chinese NER models, our approach achieves 1.18%, 0.29%, 0.18%, and 1.1% improvement on the four benchmark datasets Weibo, Resume, OntoNotes, and E-commerce, respectively, and proves the effectiveness of the model.

A new word detection method for chinese based on local context information

New Word Identification in Social Network Text Based on Time Series Information

Chinese Word Segmentation Method Based on Dictionary and Frequency of the Words

Domain-Aware Word Segmentation for Chinese Language: A Document-Level Context-Aware Model

A realistic and robust model for Chinese word segmentation

Probabilistic Chinese word segmentation with non-local information and stochastic training

A Local Generative Model For Chinese Word Segmentation

Chinese Word Segmentation Without Using Lexicon and Hand-Crafted Training Data

New Cyber Word Discovery Using Chinese Word Segmentation

Long Short-Term Memory Neural Networks for Chinese Word Segmentation.

A Local Information Perception Enhancement–Based Method for Chinese NER

Chinese Word Segmentation Probability Dictionary Training and Enrich Solution

Fast Online Training with Frequency-Adaptive Learning Rates for Chinese Word Segmentation and New Word Detection

SVM-based Hybrid Pattern for New Word Discovery

A Refined Hdp-Based Model For Unsupervised Chinese Word Segmentation

A Pragmatic Approach for Classical Chinese Word Segmentation.

Improving Chinese Word Segmentation on Micro-blog Using Rich Punctuations.

Incorporate Web Search Technology to Solve Out-of-Vocabulary Words in Chinese Word Segmentation.

Chinese Word Segmentation without Using Dictionary Based on Unsupervised Learning Strategy

A Hybrid Approach to Chinese Word Segmentation around CRFs

Chinese word segmentation at Peking University