Abstract:From the perspective of structural linguistics, we explore paradigmatic and syntagmatic lexical relations for Chinese POS tagging, an important and challenging task for Chinese language processing. Paradigmatic lexical relations are explicitly captured by word clustering on large-scale unlabeled data and are used to design new features to enhance a discriminative tagger. Syntagmatic lexical relations are implicitly captured by syntactic parsing in the constituency formalism, and are utilized via system combination. Experiments on the Penn Chinese Treebank demonstrate the importance of both paradigmatic and syntagmatic relations. Our linguistically motivated, hybrid approaches yield a relative error reduction of 18% in total over state-of-the-art baselines. Despite the effectiveness to boost accuracy, computationally expensive parsers make hybrid systems inappropriate for many realistic NLP applications. In this article, we are also concerned with improving tagging efficiency at test time. In particular, we explore unlabeled data to transfer the predictive power of hybrid models to simple sequence models. Specifically, hybrid systems are utilized to create large-scale pseudo training data for cheap models. Experimental results illustrate that the re-compiled models not only achieve high accuracy with respect to per token classification, but also serve as a front-end to a parser well.

Implementing Chinese new word discovery and POS tagging based on support vector machine

SVM-based Hybrid Pattern for New Word Discovery

Vietnamese Part of Speech Tagging Based on Multi-category Words Disambiguation Model.

CSeg& Tag1.0

Fusion of Multiple Features and Supervised Learning for Chinese OOV Term Detection and POS Guessing.

Study on Japanese Word Segmentation and POS Tagging Based on Rules and Statistics

A Unified Model for Joint Chinese Word Segmentation and POS Tagging with Heterogeneous Annotation Corpora.

Deep Learning for Chinese Word Segmentation and POS Tagging.

Towards Accurate and Efficient Chinese Part-of-Speech Tagging.

Exploring Multiple Features for POS Guessing of Chinese Unknown Words with Maximum Entropy Models

Part-of-Speech Tagging for Chinese-English Mixed Texts with Dynamic Features

A Stacked Sub-Word Model for Joint Chinese Word Segmentation and Part-of-Speech Tagging.

Chinese comments sentiment classification based on word2vec and SVMperf.

Combining Context Features by Canonical Belief Network for Chinese Part-Of-Speech Tagging.

Chinese Sentiment Classification Using A Neural Network Tool-Word2vec

Feature-rich Prepositional Phrase Boundary Identification based on SVM

A Discriminative Latent Variable Chinese Segmenter with Hybrid Word/Character Information.

CRF-based Hybrid Model for Word Segmentation, NER and Even POS Tagging

New Word Detection For Sentiment Analysis

Improved spoken term detection using support vector machines with acoustic and context features from pseudo-relevance feedback

Experimental Study of Hidden Markov Model Based Part-of-speech Tagging for Chinese Texts