Abstract:In this paper, we study the task of graph-based constituent parsing in the setting that binarization is not conducted as a pre-processing step, where a constituent tree may consist of nodes with more than two children. Previous graphbased methods on this setting typically generate hidden nodes with the dummy label inside the n-ary nodes, in order to transform the tree into a binary tree for prediction. The limitation is that the hidden nodes break the sibling relations of the n-ary node’s children. Consequently, the dependencies of such sibling constituents might not be accurately modeled and is being ignored. To solve this limitation, we propose a novel graph-based framework, which is called “recursive semi-Markov model”. The main idea is to utilize 1-order semi-Markov model to predict the immediate children sequence of a constituent candidate, which then recursively serves as a child candidate of its parent. In this manner, the dependencies of sibling constituents can be described by 1-order transition features, which solves the above limitation. Through experiments, the proposed framework obtains the F1 of 95.92% and 92.50% on the datasets of PTB and CTB 5.1 respectively. Specially, the recursive semi-Markov model shows advantages in modeling nodes with more than two children, whose average F1 can be improved by 0.3-1.1 points in PTB and 2.3-6.8 points in CTB 5.1.

English BNP Identification Based on Corpus-Trained Decision Tree

BTPK-based learning: An Interpretable Method for Named Entity Recognition

Statistics Based Hybrid Approach to Chinese Base Phrase Identification

When Are Tree Structures Necessary for Deep Learning of Representations?

Exploiting Salient Word Dependency for Chinese Np Identification: A Study on Classifier Noun Phrase

BTPK-based Interpretable Method for NER Tasks Based on Talmudic Public Announcement Logic

A corpus-based approach to English subordinate clause identification

BTPK-based interpretable method for NER tasks based on Talmudic Public Announcement Logic

Word Frequency Statistics Model For Chinese Base Noun Phrase Identification

Parsing Penn Chinese Treebank Based on Lexicalized Model

Chinese Dependency Parsing Based on Treebank

High Precision English Base Noun Phrase Identification Based on "waterfall" Model

N-ary Constituent Tree Parsing with Recursive Semi-Markov Model

A More Efficient Chinese Named Entity Recognition base on BERT and Syntactic Analysis

Automatic and Efficient Recognition of Proper Nouns Based on Maximum Entropy Model

Detecting the Countability of English Compound Nouns Using Web-based Models.

A Machine Learning Approach to Determine Semantic Dependency Structure in Chinese.

Automatic Identification of Noun Phrases Based on Statistics and Rules

Exploiting Heterogeneous Treebanks for Parsing.

A Deterministic Method To Predict Phrase Boundaries Of A Syntactic Tree

Discriminative Neural Sentence Modeling by Tree-Based Convolution