Abstract:Parsing, the task of identifying syntactic components, e.g., noun and verb phrases, in a sentence, is one of the fundamental tasks in natural language processing. Many natural language applications such as spoken-language understanding, machine translation, and information extraction, would benefit from, or even require, high accuracy parsing as a preprocessing step. Even though most state-of-the-art statistical parsers were initially constructed for parsing in English, most of them are not language-specific, in that they do not rely on properties of the language that are specific to English. Therefore, construction of a parser in a given language becomes a matter of retraining the statistical parameters with a Treebank in the corresponding language. The development of the Chinese treebank [Xia et al. 2000] spurred the construction of parsers for Chinese. However, Chinese as a language poses some unique problems for the development of a statistical parser, the most apparent being word segmentation. Since words in written Chinese are not delimited in the same way as in Western languages, the first problem that needs to be solved before an existing statistical method can be applied to Chinese is to identify the word boundaries. This is a step that is neglected by most pre-existing Chinese parsers, which assume that the input data has already been pre-segmented. This article describes a character-based statistical parser, which gives the best performance to-date on the Chinese treebank data. We augment an existing maximum entropy parser with transformation-based learning, creating a parser that can operate at the character level. We present experiments that show that our parser achieves results that are close to those achievable under perfect word segmentation conditions.

Chinese Sentence Parsing Based on Maximum Entropy Model

A maximum-entropy chinese parser augmented by transformation-based learning

Shallow Discourse Parsing with Maximum Entropy Model

Parsing-based Chinese word segmentation integrating morphological and syntactic information

An Improved Maximum Entropy Language Model and Its Application

CHUNK PARSING SCHEME FOR CHINESE SENTENCES

Exploring Multiple Features for POS Guessing of Chinese Unknown Words with Maximum Entropy Models

Chinese WSD based on features obtaining with shallow parsing

Character-Level Chinese Dependency Parsing via Modeling Latent Intra-Word Structure

Chinese Dependency Parsing Based on Treebank

An Information-Theory-based Feature Type Analysis for the Modelling of Statistical Parsing

Neural Probabilistic Model for Non-projective MST Parsing

Chinese Question Answering Based on Syntax Analysis and Answer Classification

Chinese Textual Entailment Recognition Based on Syntactic Tree Clipping

End-to-End Chinese Parsing Exploiting Lexicons

Neural Maximum Subgraph Parsing for Cross-Domain Semantic Dependency Analysis.

Exploiting limited data for parsing

Character-Based Parsing with Convolutional Neural Network.

Improving Unsupervised Constituency Parsing via Maximizing Semantic Information

Prosodic boundary prediction based on maximum entropy model with error-driven modification

Data-driven, PCFG-based and Pseudo-PCFG-based Models for Chinese Dependency Parsing