Abstract:Words provide a useful source of information for Chinese NLP, and word segmentation has been taken as a pre-processing step for most downstream tasks. For many NLP tasks, however, word segmentation can introduce noise and lead to error propagation. The rise of neural representation learning models allows sentence-level semantic information to be collected from characters directly. As a result, it is an empirical question whether a fully character-based model should be used instead of first performing word segmentation. We investigate a neural representation that simultaneously encodes character and word information without the need for segmentation. In particular, candidate words are found in a sentence by matching with a pre-defined lexicon. A lattice structured LSTM is used to encode the resulting word-character lattice, where gate vectors are used to control information flow through words, so that the more useful words can be automatically identified by end-to-end training. We compare the performance of the resulting lattice LSTM and baseline sequence LSTM structures over both character sequences and automatically segmented word sequences. Results on NER show that the character-word lattice model can significantly improve the performance. In addition, as a general sentence representation architecture, character-word lattice LSTM can also be used for learning contextualized representations. To this end, we compare lattice LSTM structure with its sequential LSTM counterpart, namely ELMo. Results show that our lattice version of ELMo gives better language modeling performances. On Chinese POS-tagging, chunking and syntactic parsing tasks, the resulting contextualized Chinese embeddings also give better performance than ELMo trained on the same data.

Chinese Word POS Tagging with Markov Logic.

Incorporating External POS Tagger for Punctuation Restoration

Towards Accurate and Efficient Chinese Part-of-Speech Tagging.

Deep Learning for Chinese Word Segmentation and POS Tagging.

Is POS Tagging Necessary or Even Helpful for Neural Dependency Parsing?

Experimental Study of Hidden Markov Model Based Part-of-speech Tagging for Chinese Texts

Exploring Multiple Features for POS Guessing of Chinese Unknown Words with Maximum Entropy Models

Vietnamese Part of Speech Tagging Based on Multi-category Words Disambiguation Model.

TPOS Tagging Method Based on BiLSTM_CRF Model

Combining Context Features by Canonical Belief Network for Chinese Part-Of-Speech Tagging.

Improving accuracy of Part-of-Speech (POS) tagging using hidden markov model and morphological analysis for Myanmar Language

Study on Japanese Word Segmentation and POS Tagging Based on Rules and Statistics

Capturing Paradigmatic and Syntagmatic Lexical Relations: Towards Accurate Chinese Part-of-Speech Tagging.

Lattice LSTM for Chinese Sentence Representation

POS Tag-enhanced Coarse-to-fine Attention for Neural Machine Translation

A Chinese Part-of-speech Tagging Approach Using Conditional Random Fields

Implementing Chinese new word discovery and POS tagging based on support vector machine

CSeg& Tag1.0

Part-of-Speech Tagging for Chinese-English Mixed Texts with Dynamic Features

A Classification-based Algorithm for Consistency Check of Part-of-Speech Tagging for Chinese Corpora.

Joint Segmentation and Tagging with Coupled Sequences Labeling