Abstract:Words provide a useful source of information for Chinese NLP, and word segmentation has been taken as a pre-processing step for most downstream tasks. For many NLP tasks, however, word segmentation can introduce noise and lead to error propagation. The rise of neural representation learning models allows sentence-level semantic information to be collected from characters directly. As a result, it is an empirical question whether a fully character-based model should be used instead of first performing word segmentation. We investigate a neural representation that simultaneously encodes character and word information without the need for segmentation. In particular, candidate words are found in a sentence by matching with a pre-defined lexicon. A lattice structured LSTM is used to encode the resulting word-character lattice, where gate vectors are used to control information flow through words, so that the more useful words can be automatically identified by end-to-end training. We compare the performance of the resulting lattice LSTM and baseline sequence LSTM structures over both character sequences and automatically segmented word sequences. Results on NER show that the character-word lattice model can significantly improve the performance. In addition, as a general sentence representation architecture, character-word lattice LSTM can also be used for learning contextualized representations. To this end, we compare lattice LSTM structure with its sequential LSTM counterpart, namely ELMo. Results show that our lattice version of ELMo gives better language modeling performances. On Chinese POS-tagging, chunking and syntactic parsing tasks, the resulting contextualized Chinese embeddings also give better performance than ELMo trained on the same data.

Chinese Spelling Check Via Bidirectional Lstm-Crf

Chinese Spelling Error Detection Using a Fusion Lattice LSTM

A Chinese OCR Spelling Check Approach Based on Statistical Language Models.

Post Text Processing of Chinese Speech Recognition Based on Bidirectional LSTM Networks and CRF

Improve Chinese Spelling Check by Reevaluation

A Hybrid Model for Chinese Spelling Check

Is Chinese Spelling Check ready? Understanding the correction behavior in real-world scenarios

SpellGCN: Incorporating Phonological and Visual Similarities into Language Models for Chinese Spelling Check

MLSL-Spell: Chinese Spelling Check Based on Multi-Label Annotation

Lattice LSTM for Chinese Sentence Representation

Read, Listen, and See: Leveraging Multimodal Information Helps Chinese Spell Checking

An Error-Guided Correction Model for Chinese Spelling Error Correction

Improving Chinese Spelling Correction by Ranking.

Bi-LSTM Neural Networks for Chinese Grammatical Error Diagnosis.

Make BERT-based Chinese Spelling Check Model Enhanced by Layerwise Attention and Gaussian

Chinese Spelling Error Detection and Correction Based on Knowledge Graph.

Chinese Grammatical Error Diagnosis Based on CRF and LSTM-CRF Model.

Exploration and Exploitation: Two Ways to Improve Chinese Spelling Correction Models

SpellBERT - A Lightweight Pretrained Model for Chinese Spelling Check.

C-LLM: Learn to Check Chinese Spelling Errors Character by Character