Personality-aware Student Simulation for Conversational Intelligent Tutoring Systems

Zhengyuan Liu,Stella Xin Yin,Geyu Lin,Nancy F. Chen

2024-04-10

Abstract:Intelligent Tutoring Systems (ITSs) can provide personalized and self-paced learning experience. The emergence of large language models (LLMs) further enables better human-machine interaction, and facilitates the development of conversational ITSs in various disciplines such as math and language learning. In dialogic teaching, recognizing and adapting to individual characteristics can significantly enhance student engagement and learning efficiency. However, characterizing and simulating student's persona remain challenging in training and evaluating conversational ITSs. In this work, we propose a framework to construct profiles of different student groups by refining and integrating both cognitive and noncognitive aspects, and leverage LLMs for personality-aware student simulation in a language learning scenario. We further enhance the framework with multi-aspect validation, and conduct extensive analysis from both teacher and student perspectives. Our experimental results show that state-of-the-art LLMs can produce diverse student responses according to the given language ability and personality traits, and trigger teacher's adaptive scaffolding strategies.

Computation and Language,Human-Computer Interaction

What problem does this paper attempt to address?

The problem that this paper attempts to solve is how to more accurately simulate and evaluate students' personality characteristics in Conversational Intelligent Tutoring Systems (ITSs). Specifically, the author proposes a framework for constructing profiles of different student groups and uses large - language models (LLMs) for personalized student simulation, especially in the language - learning scenario. This work mainly focuses on the following aspects:

1. **The need for personalized teaching**: In dialogic teaching, identifying and adapting to individual characteristics can significantly improve students' learning engagement and efficiency. However, currently, in training and evaluating Conversational ITSs, the characterization and simulation of students' personality characteristics remain a challenge.

2. **Proposal of the framework**: To overcome the above - mentioned challenges, the author proposes a framework to construct profiles of different student groups by integrating cognitive and non - cognitive factors. In addition, this framework also uses large - language models for personalized student simulation.

3. **Multi - aspect verification**: To enhance the effectiveness of the framework, the author further introduces multi - aspect verification methods and conducts extensive analysis of the generated dialogues from the perspectives of teachers and students.

4. **Experimental results**: The experimental results show that the state - of - the - art large - language models can generate diverse student activity responses according to the given language abilities and personality characteristics and trigger teachers' adaptive scaffolding strategies.

Overall, this paper aims to improve the personalized teaching effect of Conversational Intelligent Tutoring Systems by improving the accuracy and diversity of student simulation.