Economic and Financial Learning with Artificial Intelligence: A Mixed-Methods Study on ChatGPT

Holger Arndt

2024-02-23

Abstract:In the evolving landscape of digital education, chatbots have emerged as potential game-changers, promising personalized and adaptive learning experiences. This research undertook an in-depth exploration of ChatGPT's potential as an educational tool, focusing on user perceptions, experiences and learning outcomes. Through a mixed-methods approach, a diverse group of 102 participants engaged with ChatGPT, providing insights pre- and postinteraction. The study reveals a notable positive shift in perceptions after exposure, underscoring the efficacy of ChatGPT. However, challenges such as prompting effectiveness and information accuracy emerged as pivotal concerns. Introducing the concept of 'AI-learning-competence', this study lays the groundwork for future research, emphasizing the need for formal training and pedagogical integration of AI tools.

Computers and Society,Human-Computer Interaction

What problem does this paper attempt to address?

The main issue this paper attempts to address is the exploration of ChatGPT's potential as an educational tool, particularly focusing on users' perceptions, experiences, and learning outcomes. Specifically, the study aims to answer the following research questions:

1. **What are users' perceptions of ChatGPT before they interact with it?** This includes exploring users' initial concerns and expectations, and analyzing the correlation between these perceptions and variables such as gender or prior chatbot experience.
2. **How do these perceptions change after interacting with ChatGPT?** This will delve into the changes in attitudes and examine the correlation with relevant factors.
3. **What challenges and benefits do users encounter during the learning process with ChatGPT, and how can their learning experience be further enhanced?**

Through these questions, the study aims to comprehensively evaluate the effectiveness of ChatGPT in education, uncover its potential advantages and challenges, and provide guidance for future research and practice.