A Comprehensive Analysis of Text Value and Linguistic Characteristics of Chinese Language Literature Based on Text Mining Technology
Qi Li
DOI: https://doi.org/10.2478/amns-2024-2502
2024-01-01
Applied Mathematics and Nonlinear Sciences
Abstract:Abstract In this paper, webpage information is extracted by the directed crawling method in data crawling technology so as to obtain a collection of Chinese language literature, which is processed by data cleaning, Chinese word splitting, and de-duplication. Text mining techniques such as machine learning, the LDA model, and semantic networks are used to perform operations such as sentiment analysis, theme extraction, and linguistic association analysis on the acquired text. Based on the mined text, text value assessment and linguistic characterization of literary works written in Chinese are carried out. The text value is quantified and graded using the PMC index model, and the linguistic features of the text, including punctuation, vocabulary, and sentences, are analyzed by constructing a linguistic feature model. Eight of the 10 Chinese literary works selected in this paper, including Alive, have text values at an excellent level. The frequently used punctuation mark in works is the period. The average word length is around 2.75, and the degree of discreteness of sentences is small.