Abstract:Dependency parsing has gained more and more interest in natural language processing in recent years due to its simplicity and general applicability for diverse languages. Previous work demonstrates that part-of-speech (POS) is an indispensable feature in dependency parsing since pure lexical features suffer from serious data sparseness problem. However, due to little morphological changes, Chinese POS tagging has proven to be much more challenging than morphology-richer languages such as English (94% vs. 97% on POS tagging accuracy). This leads to severe error propagation for Chinese dependency parsing. Our experiments show that parsing accuracy drops by about 6% when replacing manual POS tags of the input sentence with automatic ones generated by a state-of-the-art statistical POS tagger. To address this issue, this paper proposes a solution by jointly optimizing POS tagging and dependency parsing in a unique model. We propose for our joint models several dynamic programming based decoding algorithms which can incorporate rich POS tagging and syntactic features. Then we present an effective pruning strategy to reduce the search space of candidate POS tags, leading to significant improvement of parsing speed. Experimental results on two Chinese data sets, i.e. Penn Chinese Treebank 5.1 and Penn Chinese Treebank 7, demonstrate that our joint models significantly improve both the state-of-the-art tagging and parsing accuracies. Detailed analysis shows that the joint method can help resolve syntax-sensitive POS ambiguities {ssrNN,ssrVV}. In return, the POS tags become more reliable and helpful for parsing since the syntactic features are used in POS tagging. This is the fundamental reason for the performance improvement.

A Self-Learning Part of Speech Tagging Integrated with Partial Syntactic Analysis

Incorporating External POS Tagger for Punctuation Restoration

Towards Accurate and Efficient Chinese Part-of-Speech Tagging.

A Separately Passive-Aggressive Training Algorithm for Joint POS Tagging and Dependency Parsing

A Multi-input Chinese Part of Speech Tagging System Based on Cascaded Finite State Automaton

Capturing Paradigmatic and Syntagmatic Lexical Relations: Towards Accurate Chinese Part-of-Speech Tagging.

Research on the Approach of Integrating Chinese Word Segmentation with Part-of-speech Tagging

TAKTAG: Two-phase learning method for hybrid statistical/rule-based part-of-speech disambiguation

Improving Sequence Tagging Using Machine-Learning Techniques

Exploiting Lexical Information for Function Tag Labeling

Joint Optimization for Chinese POS Tagging and Dependency Parsing

Study on Japanese Word Segmentation and POS Tagging Based on Rules and Statistics

Study on Architectures for Chinese POS Tagging and Parsing

Experimental Study of Hidden Markov Model Based Part-of-speech Tagging for Chinese Texts

Joint Models for Chinese POS Tagging and Dependency Parsing.

Modelling the Lexicon in Unsupervised Part of Speech Induction

Improving Chinese POS Tagging with Dependency Parsing.

Embedded Machine Learning Systems For Robust Spoken Language Parsing

Part-of-Speech Tagging with Bidirectional Long Short-Term Memory Recurrent Neural Network

Reliable Part-of-Speech Tagging of Historical Corpora through Set-Valued Prediction

Vietnamese Part of Speech Tagging Based on Multi-category Words Disambiguation Model.