Abstract:Dependency parsing has gained more and more interest in natural language processing in recent years due to its simplicity and general applicability for diverse languages. Previous work demonstrates that part-of-speech (POS) is an indispensable feature in dependency parsing since pure lexical features suffer from serious data sparseness problem. However, due to little morphological changes, Chinese POS tagging has proven to be much more challenging than morphology-richer languages such as English (94% vs. 97% on POS tagging accuracy). This leads to severe error propagation for Chinese dependency parsing. Our experiments show that parsing accuracy drops by about 6% when replacing manual POS tags of the input sentence with automatic ones generated by a state-of-the-art statistical POS tagger. To address this issue, this paper proposes a solution by jointly optimizing POS tagging and dependency parsing in a unique model. We propose for our joint models several dynamic programming based decoding algorithms which can incorporate rich POS tagging and syntactic features. Then we present an effective pruning strategy to reduce the search space of candidate POS tags, leading to significant improvement of parsing speed. Experimental results on two Chinese data sets, i.e. Penn Chinese Treebank 5.1 and Penn Chinese Treebank 7, demonstrate that our joint models significantly improve both the state-of-the-art tagging and parsing accuracies. Detailed analysis shows that the joint method can help resolve syntax-sensitive POS ambiguities {ssrNN,ssrVV}. In return, the POS tags become more reliable and helpful for parsing since the syntactic features are used in POS tagging. This is the fundamental reason for the performance improvement.

A Reranking Method for Syntactic Parsing with Heterogeneous Treebanks.

Discriminative Parse Reranking for Chinese with Homogeneous and Heterogeneous Annotations

Exploiting Heterogeneous Treebanks for Parsing.

Applying Tree Kernel to Chinese Syntactic Parsing Reranking

Exploiting Multiple Treebanks for Parsing with Quasi-Synchronous Grammars

Transition-based Parsing with Context Enhancement and Future Reward Reranking.

A Search-Based Dynamic Reranking Model for Dependency Parsing.

A Neural Network Based Translation Constrained Reranking Model for Chinese Dependency Parsing

Chinese Dependency Parsing Based on Treebank

K-Best Combination of Syntactic Parsers.

A Ranking-based Approach to Word Reordering for Statistical Machine Translation.

Paraphrase and Parallel Treebank for the Comparison of French and Chinese Syntax

Introducing more features to improve Chinese shift-reduce parsing

Improving Feature-Rich Transition-Based Constituent Parsing Using Recurrent Neural Networks.

Exploiting Multi-typed Treebanks for Parsing with Deep Multi-task Learning.

Joint Optimization for Chinese POS Tagging and Dependency Parsing

Cross-Lingual Universal Dependency Parsing Only from One Monolingual Treebank

Supervised Treebank Conversion: Data and Approaches.

A Neural Transition-Based Approach for Semantic Dependency Graph Parsing

Parsing Penn Chinese Treebank Based on Lexicalized Model

A Re-ranking Model for Dependency Parser with Recursive Convolutional Neural Network