Abstract:Dependency parsing has gained more and more interest in natural language processing in recent years due to its simplicity and general applicability for diverse languages. Previous work demonstrates that part-of-speech (POS) is an indispensable feature in dependency parsing since pure lexical features suffer from serious data sparseness problem. However, due to little morphological changes, Chinese POS tagging has proven to be much more challenging than morphology-richer languages such as English (94% vs. 97% on POS tagging accuracy). This leads to severe error propagation for Chinese dependency parsing. Our experiments show that parsing accuracy drops by about 6% when replacing manual POS tags of the input sentence with automatic ones generated by a state-of-the-art statistical POS tagger. To address this issue, this paper proposes a solution by jointly optimizing POS tagging and dependency parsing in a unique model. We propose for our joint models several dynamic programming based decoding algorithms which can incorporate rich POS tagging and syntactic features. Then we present an effective pruning strategy to reduce the search space of candidate POS tags, leading to significant improvement of parsing speed. Experimental results on two Chinese data sets, i.e. Penn Chinese Treebank 5.1 and Penn Chinese Treebank 7, demonstrate that our joint models significantly improve both the state-of-the-art tagging and parsing accuracies. Detailed analysis shows that the joint method can help resolve syntax-sensitive POS ambiguities {ssrNN,ssrVV}. In return, the POS tags become more reliable and helpful for parsing since the syntactic features are used in POS tagging. This is the fundamental reason for the performance improvement.

Joint Training and Decoding Using Virtual Nodes for Cascaded Segmentation and Tagging Tasks.

Joint Segmentation and Tagging with Coupled Sequences Labeling

A Joint Segmenting And Labeling Approach For Chinese Lexical Analysis

A Cascade Binary Tagging Joint Extraction Method

Improving the Efficiency for Joint POS -Tagging and Dependency Parsing with Uptraining

Integrated Chinese Segmentation, Parsing and Named Entity Recognition

A CRFS-based joint labeling approach for cascaded tasks

A Coarse-to-Fine Labeling Framework for Joint Word Segmentation, POS Tagging, and Constituent Parsing

Joint Chinese Word Segmentation and POS Tagging System with Undirected Graphical Models

A Simple and Effective Neural Model for Joint Word Segmentation and POS Tagging.

A Joint Model for Graph-Based Chinese Dependency Parsing.

Joint Optimization for Chinese POS Tagging and Dependency Parsing

Incorporating Knowledge for Joint Chinese Word Segmentation and Part-of-speech Tagging with SynSemGCN

Encoding multi-granularity structural information for joint Chinese word segmentation and POS tagging

Joint Chinese Word Segmentation and Part-of-speech Tagging via Two-stage Span Labeling

Joint Models for Chinese POS Tagging and Dependency Parsing.

Joint Tokenization and Translation

Joint POS Tagging and Dependency Parsing with Transition-based Neural Networks

Joint Word Segmentation, Pos-Tagging And Syntactic Chunking

Multi-Task Cross-Lingual Sequence Tagging from Scratch

A neural joint model for Vietnamese word segmentation, POS tagging and dependency parsing