Generative AI for Enhancing Active Learning in Education: A Comparative Study of GPT-3.5 and GPT-4 in Crafting Customized Test Questions

Hamdireza Rouzegar,Masoud Makrehchi

2024-06-20

Abstract:This study investigates how LLMs, specifically GPT-3.5 and GPT-4, can develop tailored questions for Grade 9 math, aligning with active learning principles. By utilizing an iterative method, these models adjust questions based on difficulty and content, responding to feedback from a simulated 'student' model. A novel aspect of the research involved using GPT-4 as a 'teacher' to create complex questions, with GPT-3.5 as the 'student' responding to these challenges. This setup mirrors active learning, promoting deeper engagement. The findings demonstrate GPT-4's superior ability to generate precise, challenging questions and notable improvements in GPT-3.5's ability to handle more complex problems after receiving instruction from GPT-4. These results underscore the potential of LLMs to mimic and enhance active learning scenarios, offering a promising path for AI in customized education. This research contributes to understanding how AI can support personalized learning experiences, highlighting the need for further exploration in various educational contexts

Computation and Language,Artificial Intelligence,Machine Learning

What problem does this paper attempt to address?

The problem this paper attempts to address is: How to utilize large language models (LLMs), particularly GPT-3.5 and GPT-4, to generate personalized test questions that align with active learning principles, in order to enhance the personalization and effectiveness of education.

Specifically, the paper explores the following aspects:
1. **Design of Personalized Test Questions**: Investigating how to use LLMs to generate math test questions suitable for different student levels and needs, particularly for 9th-grade math courses.
2. **Development of Adaptive Learning Tools**: Adjusting the difficulty and content of questions through an iterative method based on student feedback, thereby achieving more effective personalized learning.
3. **Simulating Active Learning Scenarios**: Having GPT-4 play the role of a "teacher" to generate complex questions, while GPT-3.5 plays the role of a "student" to answer these questions, simulating a dynamic active learning environment.
4. **Evaluating the Potential of LLMs in Education**: Comparing the abilities of GPT-3.5 and GPT-4 in generating precise and challenging questions, and assessing the impact of these models on improving student learning outcomes.

Through these studies, the paper aims to explore the potential applications of LLMs in the field of education, particularly in the areas of personalized learning and active learning.