Abstract:From the perspective of structural linguistics, we explore paradigmatic and syntagmatic lexical relations for Chinese POS tagging, an important and challenging task for Chinese language processing. Paradigmatic lexical relations are explicitly captured by word clustering on large-scale unlabeled data and are used to design new features to enhance a discriminative tagger. Syntagmatic lexical relations are implicitly captured by syntactic parsing in the constituency formalism, and are utilized via system combination. Experiments on the Penn Chinese Treebank demonstrate the importance of both paradigmatic and syntagmatic relations. Our linguistically motivated, hybrid approaches yield a relative error reduction of 18% in total over state-of-the-art baselines. Despite the effectiveness to boost accuracy, computationally expensive parsers make hybrid systems inappropriate for many realistic NLP applications. In this article, we are also concerned with improving tagging efficiency at test time. In particular, we explore unlabeled data to transfer the predictive power of hybrid models to simple sequence models. Specifically, hybrid systems are utilized to create large-scale pseudo training data for cheap models. Experimental results illustrate that the re-compiled models not only achieve high accuracy with respect to per token classification, but also serve as a front-end to a parser well.

A Classification-based Algorithm for Consistency Check of Part-of-Speech Tagging for Chinese Corpora.

Combining Context Features by Canonical Belief Network for Chinese Part-Of-Speech Tagging.

A Chinese Part-of-speech Tagging Approach Using Conditional Random Fields

Incorporating External POS Tagger for Punctuation Restoration

Vietnamese Part of Speech Tagging Based on Multi-category Words Disambiguation Model.

Part-of-Speech Tagging for Chinese-English Mixed Texts with Dynamic Features

A Unified Model for Joint Chinese Word Segmentation and POS Tagging with Heterogeneous Annotation Corpora.

Quality Assurance Of Automatic Annotation Of Very Large Corpora: A Study Based On Heterogeneous Tagging Systems

Joint Chinese Word Segmentation and POS Tagging on Heterogeneous Annotated Corpora with Multiple Task Learning.

Towards Accurate and Efficient Chinese Part-of-Speech Tagging.

BUPT Systems in the SIGHAN Bakeoff 2007.

Experimental Study of Hidden Markov Model Based Part-of-speech Tagging for Chinese Texts

Attention-based BILSTM network with part-of-speech features for Chinese text classification

Implementing Chinese new word discovery and POS tagging based on support vector machine

Fusion of Multiple Features and Supervised Learning for Chinese OOV Term Detection and POS Guessing.

Reducing Approximation and Estimation Errors for Chinese Lexical Processing with Heterogeneous Annotations

Exploring Multiple Features for POS Guessing of Chinese Unknown Words with Maximum Entropy Models

CSeg& Tag1.0

A Stacked Sub-Word Model for Joint Chinese Word Segmentation and Part-of-Speech Tagging.

Capturing Paradigmatic and Syntagmatic Lexical Relations: Towards Accurate Chinese Part-of-Speech Tagging.

Study on Japanese Word Segmentation and POS Tagging Based on Rules and Statistics