Abstract:N-gram language modelling, a proven and effective method in NLP, is widely used to calculate the probability of a sentence in natural language. Language pattern is a linguistic level between word/character and sentence, which exists in pattern grammar. In this research, the approach of language model and language pattern are combined for the first time, and language patterns are studied by use of the N-gram model. Chinese function-word-centered patterns are extracted from the LCMC corpus, and aligned into pattern chains. The language model is trained from these chains to investigate the properties and distribution of Chinese function words, the interaction of content words and function words, and the interaction between patterns. The results indicate that there are approximately 10,000 function-word-centered patterns in the texts, which are distributed exponentially. This research summarizes the most common function-word-centered patterns and content-word-centered patterns, and discusses the interactions of patterns based on corpus data. The bigram language model of these patterns reflects the restrictions of function words. In addition, the research adopts an innovative method to visualize the interactions between patterns. This research fills the research gap between word/character and sentence and reveals basic Chinese pattern categories and the interactions between patterns, which makes a significant contribution to Chinese linguistic research, and improves the efficiency of NLP.

A Description of Chinese NPs Using Head-Driven Phrase Structure Grammar

A Description of Chinese NPs using Head-Driven Phrase Structure Grammar

On Generalized-Topic-Based Chinese Discourse Structure.

Head-Driven Phrase Structure Grammar Parsing On Penn Treebank

Head-driven Phrase Structure Parsing in O($n^3$) Time Complexity

Does interlanguage grammar project intermediate categories? Evidence of partial representation from one‐substitution by Chinese learners of English

NPs, Not DPs: the NP Vs. DP Debate in the Context of Dependency Grammar

Grammatical Relations In Chinese: Gb-Ground Extraction And Data-Driven Parsing

A Head-Annotated Synchronous Context-Free Grammar for Hierarchical Phrase-Based Translation

Classifying Syntactic Categories in the Chinese Dependency Network.

Quantitative Research on Chinese Sentences Structure Based on Pattern Grammar

Chunks Are Components: A Dependency Grammar Approach to the Syntactic Structure of Mandarin

N-gram Language Model for Chinese Function-word-centered Patterns

A hierarchy-based constraint dependency grammar parsing for Chinese

A sort Approach for Anaphora Resolution of Chinese Personal Pronoun Based on Machine Learning Method

Improvements on Head-Driven Probabilistic Parsing for Chinese

A Head-Driven Approach For Automatic Identification Of Chinese Coordinate Structures

Learning Grammar With Explicit Annotations For Subordinating Conjunctions

“Subject-predicate predicate sentences” in modern Mandarin Chinese: A Cardiff Grammar approach

A Syntactic Analysis of Chinese Locative Preposition Phrases from a Cross-Linguistic Perspective

An Attempt to Develop a Neural Parser based on Simplified Head-Driven Phrase Structure Grammar on Vietnamese