Abstract:Abstract There exists no sentence boundary in most classical Chinese literature texts. Since it is difficult to read literature of this kind, experts in literature or linguistics would segment the sentence manually. This article explores the effectiveness of classical Chinese sentence segmentation method so as to provide a reference for classical Chinese punctuation. On the basis of the machine learning methods, we chose three components of machine learning, namely models, tagging schemes, and features, to compare the learning results. The models include conditional random field (CRF) models, long short term memory (LSTM) models, BiLSTM–CRF models, and three Bidirectional Encoder Representation from Transformers (BERT) models. There are five tagging schemes in this article and three features including the statistical feature, Guangyun, and Fanqie. Finally, the performance of the combined feature template is evaluated by ten-fold cross-validation on four classical Chinese texts in different genres. The SikuBERT model is proved to be the most effective model for sentence segmentation at present. Different tagging schemes and various features are introduced. The results show that 5-tag-J tagging schemes can improve performance. Statistical feature, as an important clue for classical Chinese sentence segmentation, is useful in related tasks, but Guangyun and Fanqie have little impact. Other important factors of sentence segmentation are genres and writing styles.

On Clearing Up the Western Concepts in Chinese Sentence Pattern Analysis While Rebuilding the Mainland Sentence Pattern System

On Generalized-Topic-Based Chinese Discourse Structure.

On the Functional Analysis of Chinese Sentence Patterns

Studies of Chinese Syntax in the Last 20 Years

Formalized Chinese Sentence Pattern Structure and Its Hierarchical Analysis

Eight Types of Chinese Sentence Patterns

Exploring the Formal Language of Chinese Paintings——Focusing on Reform and Academic Basis of Pedagogical Chinese Paintings

Semantic Dependency Analysis of Special Sentence Patterns in Ancient Chinese.

Formal Schema Of Diagrammatic Chinese Syntactic Analysis

Studies on Grammar Diversity from Chinese and Western Cultural Perspectives

The Distinction of Conceptual Meaning and Connotative Meaning in Mandarin Tautological Sentences

Quantitative Research on Chinese Sentences Structure Based on Pattern Grammar

The Realization of Sentence Constructions' Meanings in Modern Chinese

On Functional Structures in Chinese Clause

A Probe into the Features of Animate and Inanimate Sentence Structures in Chinese and English

A Constructional Approach to the Sentence Pattern Exemplified by "Wang Mian Si-le Fuqin"

Automatic sentence segmentation for classical Chinese: The Spring and Autumn Annals as an example

Cross-domain Chinese Sentence Pattern Parsing

Parsing the Logical Embedded Complex Sentences in Chinese

The Comparative Analyses of Sentence Structure and Subjects Between English and Chiaese

De-constructing small clauses: The case of Mandarin Chinese