Abstract:Classical Chinese literature, with its long history spanning thousands of years, serves as an invaluable resource for historical and humanistic studies. Previous classical Chinese language models have achieved significant progress in semantic understanding. However, they largely neglected the dynamic evolution of language across different historical eras. In this paper, we introduce a novel diachronic pre-trained language model tailored for classical Chinese texts. This model utilizes a time-based transformer architecture that captures the continuous evolution of semantics over time. Moreover, it adeptly balances the contextual and temporal information, minimizing semantic ambiguities from excessive time-related inputs. A high-quality diachronic corpus for classical Chinese is developed for training. This corpus spans from the pre-Qin dynasty to the Qing dynasty and includes a diverse array of genres. We validate its effectiveness by enriching a well-known classical Chinese word sense disambiguation dataset with additional temporal annotations. The results demonstrate the state-of-the-art performance of our model in discerning classical Chinese word meanings across different historical periods. Our research helps linguists to rapidly grasp the extent of semantic changes across different periods from vast corpora.1 1

A New Perspective on the Diachronic Evolution of Chinese Frequent-used Words

Diachronic Synonymy and Polysemy: Exploring Dynamic Relation Between Forms and Meanings of Words Based on Word Embeddings

Chinese Evolution in Recent 150 Years: A Diachronic Study of Word Frequency in the Gospel of Mark

Findings Summary of Medieval and Modern Chinese Lexical Research

On the New Synonyms in Contemporary Chinese

A Study on the Evolution of the Verbal Syntactic Valence Based on Corpus

Using Existing Words to Express New Meanings:a Kind of Commonly Used Semantic Expansion Mode in Contemporary Chinese

The Development and Change of Synonym in Modern Chinese

How Does Language Change As a Lexical Network? an Investigation Based on Written Chinese Word Co-Occurrence Networks

Lexical Semantic Variation and Social Change：Quantitative Observation and Analysis

Research into Synonyms and Antonym in "wu Yue Chun Qiu"

A Diachronic Study of Chinese Word Length Distribution.

A New Perspective on Polysemy Research:A Serial Study on E.V.Paducheva's Lexical Dynamic Model

A Study of Synonyms in the Slang Dictionaries in Ming and Qing Dynasties

A Corpus-based Study of the Distinction of English Synonyms for Chinese Learners

On the Formation of Synonyms in Old Chinese

A Diachronic Language Model for Long-Time Span Classical Chinese

On Expansion and Features of Word-formation between English and Chinese New Words

A Research of the Auxiliary Words of Modern Chinese and its Reclassification

An Analysis of the Synonymous Combinations of Culture Words in Ancient Chinese

Synergetic Properties of Lexical Structures in Chinese and English.