Surveying the Dead Minds: Historical-Psychological Text Analysis with Contextualized Construct Representation (CCR) for Classical Chinese

Yuqi Chen,Sixuan Li,Ying Li,Mohammad Atari

2024-03-01

Abstract:In this work, we develop a pipeline for historical-psychological text analysis in classical Chinese. Humans have produced texts in various languages for thousands of years; however, most of the computational literature is focused on contemporary languages and corpora. The emerging field of historical psychology relies on computational techniques to extract aspects of psychology from historical corpora using new methods developed in natural language processing (NLP). The present pipeline, called Contextualized Construct Representations (CCR), combines expert knowledge in psychometrics (i.e., psychological surveys) with text representations generated via transformer-based language models to measure psychological constructs such as traditionalism, norm strength, and collectivism in classical Chinese corpora. Considering the scarcity of available data, we propose an indirect supervised contrastive learning approach and build the first Chinese historical psychology corpus (C-HI-PSY) to fine-tune pre-trained models. We evaluate the pipeline to demonstrate its superior performance compared with other approaches. The CCR method outperforms word-embedding-based approaches across all of our tasks and exceeds prompting with GPT-4 in most tasks. Finally, we benchmark the pipeline against objective, external data to further verify its validity.

Computation and Language,Artificial Intelligence,Computers and Society

What problem does this paper attempt to address?

The paper aims to address the issue of how to extract psychological variables from classical Chinese texts using Natural Language Processing (NLP) techniques. Specifically, the researchers developed a pipeline called "Contextualized Construct Representation" (CCR) to analyze historical psychological data in classical Chinese texts. This method combines expertise in psychometrics with text representations generated by transformer-based language models to measure psychological constructs such as traditionalism, norm strength, and collectivism.

The study faces two main challenges:
1. Popular psychological self-report questionnaires are mostly in English, making it difficult to align them with classical Chinese texts.
2. The lack of psychology-specific transformer models tailored for classical Chinese makes it challenging to obtain high-quality historical text representations.

To address these issues, the authors proposed a cross-lingual questionnaire conversion pipeline and constructed the first Chinese Historical Psychology Corpus (C-HI-PSY), using indirect supervised contrastive learning to fine-tune pre-trained models. Through these means, the CCR method performed excellently in multiple tasks, outperforming word embedding-based methods (DDR) and prompt-based methods using GPT-4. Additionally, the authors validated the method's effectiveness using external annotated data, demonstrating its practical application value in measuring constructs such as traditionalism and authoritarian attitudes.