Abstract:This article investigates a relatively underdeveloped subject in natural language processing---the generation of punctuation marks. From a theoretical perspective, we study 16 Chinese punctuation marks as defined in the Chinese national standard of punctuation usage, and categorize these punctuation marks into three different types according to their syntactic properties. We implement a three-tier maximum entropy model incorporating linguistically-motivated features for generating the commonly used Chinese punctuation marks in unpunctuated sentences output by a surface realizer. Furthermore, we present a method to automatically extract cue words indicating sentence-final punctuation marks as a specialized feature to construct a more precise model. Evaluating on the Penn Chinese Treebank data, the MaxEnt model achieves an f -score of 79.83% for punctuation insertion and 74.61% for punctuation restoration using gold data input, 79.50% for insertion and 73.32% for restoration using parser-based imperfect input. The experiments show that the MaxEnt model significantly outperforms a baseline 5-gram language model that scores 54.99% for punctuation insertion and 52.01% for restoration. We show that our results are not far from human performance on the same task with human insertion f -scores in the range of 81-87% and human restoration in the range of 71-82%. Finally, a manual error analysis of the generation output shows that close to 40% of the mismatched punctuation marks do in fact result in acceptable choices, a fact obscured in the automatic string-matching based evaluation scores.

Accurate and Robust LFG-Based Generation for Chinese.

Data-driven, PCFG-based and Pseudo-PCFG-based Models for Chinese Dependency Parsing

A Linguistically Inspired Statistical Model for Chinese Punctuation Generation

LFG for Chinese: Issues of Representation and Computation

Recovering Non-Local Dependencies for Chinese

Dependency Based Chinese Sentence Realization

Neural Bi-Lexicalized PCFG Induction

Automatic Chinese Factual Question Generation.

Dependency-based N-Gram Models for General Purpose Sentence Realisation

Method for Layered Chinese Parsing Based on Subsidiary Context and Lexical Information

An Interactive Method for Lexicalized Parsing and Subcategorization Frame Acquisition

An Empirical Study of Compound PCFGs

Joint n-gram Chinese language modeling with an application to Chinese word segmentation

Complete Syntactic Analysis Bases on Multi-level Chunking

Generating Responses with a Given Syntactic Pattern in Chinese Dialogues.

Accurate Learning for Chinese Function Tags from Lexical Evidence

A Semantics Oriented Grammar for Chinese Treebanking

Error feedback based lexical entity extraction for Chinese language modeling

FCGEC: Fine-Grained Corpus for Chinese Grammatical Error Correction

A Chinese Parser Based on Probabilistic Context Free Grammar

RESEARCH ON A CHINESE LANGUAGE MODEL BASED ON MULTI KNOWLEDGE SOURCES AND ITS IMPLEMENTATION