Does chat change LLM's mind? Impact of Conversation on Psychological States of LLMs

Junhyuk Choi,Yeseon Hong,Minju Kim,Bugeun Kim

2024-12-01

Abstract:The recent growth of large language models (LLMs) has enabled more authentic, human-centered interactions through multi-agent systems. However, investigation into how conversations affect the psychological states of LLMs is limited, despite the impact of these states on the usability of LLM-based systems. In this study, we explored whether psychological states change during multi-agent interactions, focusing on the effects of conversation depth, topic, and speaker. We experimentally investigated the behavior of 10 LLMs in open-domain conversations. We employed 14 questionnaires and a topic-analysis method to examine the behavior of LLMs across four aspects: personality, interpersonal relationships, motivation, and emotion. The results revealed distinct psychological trends influenced by conversation depth and topic, with significant variations observed between different LLM families and parameter sizes.

Computers and Society,Computation and Language

What problem does this paper attempt to address?

The problem that this paper attempts to solve is to explore how conversations affect the mental states of large language models (LLMs). Specifically, researchers are concerned with the influence of the depth, topics, and speaker types of conversations on the mental states of LLMs in multi - agent systems. The importance of this problem lies in the fact that although LLMs can generate responses close to those of humans, currently, there is limited understanding of the changes in the mental states of these models during the conversation process, and these changes may affect the usability of LLM - based systems.

### Research Background

In recent years, with the development of large language models, they have achieved more realistic, human - centered interactions in multi - agent systems. However, there are relatively few studies on how conversations affect the mental states of LLMs. Although these mental states have an important impact on the usability of LLM - based systems, current research mainly focuses on single LLMs or conversations for specific tasks, and little is known about the changes in mental states in open - domain conversations.

### Research Objectives

This study aims to explore the following aspects:

1. **Conversation Depth**: How the depth of a conversation affects the mental states of LLMs.
2. **Topics**: Whether different topics will lead to different changes in the mental states of LLMs.
3. **Speaker Types**: Whether there are differences in the mental states exhibited by different LLM models in conversations.

### Research Methods

To answer the above questions, researchers designed a series of experiments. By having 10 different LLM models engage in open - domain conversations and using 14 questionnaires to evaluate mental states in four aspects: personality, interpersonal relationships, motivation, and emotion. The experimental framework draws on the human psychology experiments by Aron et al. (1997). By controlling the order and depth of conversation topics, the changes in the mental states of LLMs at different stages are observed.

### Main Findings

1. **Personality**: Most models do not have significant changes in personality, but some models (such as GPT - 3.5 Turbo) show a consistent increasing or decreasing trend.
2. **Interpersonal Relationships**: As the conversation depth increases, the perception of LLMs in interpersonal relationships is enhanced, especially more obvious in larger models.
3. **Motivation**: The changes in internal motivation and financial motivation vary among different models, and some models show a consistent increase or decrease.
4. **Emotion**: Most models do not have significant changes in emotional ability, but some models (such as LLaMA 3 - 8B) show a consistent increase.

### Conclusions

This study shows that the depth and topics of conversations do have an impact on the mental states of LLMs, especially in terms of interpersonal relationships and emotions. The differences between different models also indicate that the changes in the mental states of LLMs are affected not only by the conversation content but also by their architecture and parameter scale. These findings provide an important reference for designing more human - friendly LLM systems in the future.

### Formula Representation

In this article, although no complex mathematical formulas are involved, the following symbols are used when describing statistical analysis:

- \(\Delta_{i,j}:=s_i - s_j\) represents the difference between the \(i\) - th and \(j\) - th measurements.
- The Shapiro - Wilk test is used to verify whether the data conforms to a normal distribution.
- Repeated - measures ANOVA and Friedman test are used to analyze data measured multiple times on the same participant.
- Tukey's test and Wilcoxon signed - rank test are used for post - hoc tests to verify the change trends.

These symbols and methods ensure the accuracy and interpretability of the experimental results.