Abstract:Dependency parsing has gained more and more interest in natural language processing in recent years due to its simplicity and general applicability for diverse languages. Previous work demonstrates that part-of-speech (POS) is an indispensable feature in dependency parsing since pure lexical features suffer from serious data sparseness problem. However, due to little morphological changes, Chinese POS tagging has proven to be much more challenging than morphology-richer languages such as English (94% vs. 97% on POS tagging accuracy). This leads to severe error propagation for Chinese dependency parsing. Our experiments show that parsing accuracy drops by about 6% when replacing manual POS tags of the input sentence with automatic ones generated by a state-of-the-art statistical POS tagger. To address this issue, this paper proposes a solution by jointly optimizing POS tagging and dependency parsing in a unique model. We propose for our joint models several dynamic programming based decoding algorithms which can incorporate rich POS tagging and syntactic features. Then we present an effective pruning strategy to reduce the search space of candidate POS tags, leading to significant improvement of parsing speed. Experimental results on two Chinese data sets, i.e. Penn Chinese Treebank 5.1 and Penn Chinese Treebank 7, demonstrate that our joint models significantly improve both the state-of-the-art tagging and parsing accuracies. Detailed analysis shows that the joint method can help resolve syntax-sensitive POS ambiguities {ssrNN,ssrVV}. In return, the POS tags become more reliable and helpful for parsing since the syntactic features are used in POS tagging. This is the fundamental reason for the performance improvement.

Optimization of Pinyin Input based on Dependency Relationship

Exploiting Word Positional Information in Ngram Model for Chinese Text Input Method

Improving Chinese POS Tagging with Dependency Parsing.

Joint Optimization for Chinese POS Tagging and Dependency Parsing

Interrelations Among Dependency Tree Widths, Heights And Sentence Lengths

Data-driven, PCFG-based and Pseudo-PCFG-based Models for Chinese Dependency Parsing

What Factors Are Associated with Dependency Distances to Ensure Easy Comprehension? A Case Study of Ba Sentences in Mandarin Chinese

Classifying Syntactic Categories in the Chinese Dependency Network.

A Joint Graph Model For Pinyin-To-Chinese Conversion With Typo Correction

Integrating Pinyin to Improve Spelling Errors Detection for Chinese Language

Dependency syntax guided BERT-BiLSTM-GAM-CRF for Chinese NER

Joint Models for Chinese POS Tagging and Dependency Parsing.

An integrated system for semantic analysis of Chinese

A Statistical Dependency Parser of Chinese under Small Training Data *

Chinese Dependency Parsing Model Based on Lexical Governing Degree

CHINESE SENTENCE SIMILARITY COMPUTING BASED ON IMPROVED EDIT-DISTANCE AND DEPENDENCY GRAMMAR

Research on Bilingual Dependency Relationship Mapping for Chinese-English Lexicon Construction

A Unified Model for Joint Chinese Word Segmentation and Dependency Parsing

A Comparison of Chinese Parsers for Stanford Dependencies.

Chinese Dependency Parsing with Maximum Entropy Principle

Chinese Sentence Similarity Computing Based on Semantic Dependency Relationship Analysis