Abstract:Words provide a useful source of information for Chinese NLP, and word segmentation has been taken as a pre-processing step for most downstream tasks. For many NLP tasks, however, word segmentation can introduce noise and lead to error propagation. The rise of neural representation learning models allows sentence-level semantic information to be collected from characters directly. As a result, it is an empirical question whether a fully character-based model should be used instead of first performing word segmentation. We investigate a neural representation that simultaneously encodes character and word information without the need for segmentation. In particular, candidate words are found in a sentence by matching with a pre-defined lexicon. A lattice structured LSTM is used to encode the resulting word-character lattice, where gate vectors are used to control information flow through words, so that the more useful words can be automatically identified by end-to-end training. We compare the performance of the resulting lattice LSTM and baseline sequence LSTM structures over both character sequences and automatically segmented word sequences. Results on NER show that the character-word lattice model can significantly improve the performance. In addition, as a general sentence representation architecture, character-word lattice LSTM can also be used for learning contextualized representations. To this end, we compare lattice LSTM structure with its sequential LSTM counterpart, namely ELMo. Results show that our lattice version of ELMo gives better language modeling performances. On Chinese POS-tagging, chunking and syntactic parsing tasks, the resulting contextualized Chinese embeddings also give better performance than ELMo trained on the same data.

ELCA: Enhanced boundary location for Chinese named entity recognition via contextual association

A Local Information Perception Enhancement–Based Method for Chinese NER

Hierarchical Lexicon Embedding Architecture for Chinese Named Entity Recognition

Improving Chinese Named Entity Recognition Based on Lexical Information Adjustment

Lattice LSTM for Chinese Sentence Representation

LACNNER: Lexicon-Aware Character Representation for Chinese Nested Named Entity Recognition.

Exploiting Character-Word Fusion to Enhance Chinese Named Entity Recognition Combined with Multi-head Attention Mechanism

Unified Lattice Graph Fusion for Chinese Named Entity Recognition

ZH-NER: Chinese Named Entity Recognition with Adversarial Multi-task Learning and Self-Attentions.

Chinese Named Entity Recognition Fusing Lexical and Syntactic Information.

Survey of Chinese Named Entity Recognition

Chinese Named-Entity Recognition Via Self-Attention Mechanism and Position-Aware Influence Propagation Embedding

A multi-layer soft lattice based model for Chinese clinical named entity recognition

Enhanced Chinese Domain Named Entity Recognition: An Approach with Lexicon Boundary and Frequency Weight Features

Dynamic Modeling Cross- and Self-Lattice Attention Network for Chinese NER

KCB-FLAT: Enhancing Chinese Named Entity Recognition with Syntactic Information and Boundary Smoothing Techniques

Neural Chinese Named Entity Recognition via CNN-LSTM-CRF and Joint Training with Word Segmentation

A Novel Character-Word Fusion Chinese Named Entity Recognition Model Based on Attention Mechanism

A Chinese named entity recognition model: integrating label knowledge and lexicon information

Adversarial Multi-Task Learning for Efficient Chinese Named Entity Recognition

A Boundary Regression Model for Nested Named Entity Recognition