Embrace Opportunities and Face Challenges: Using ChatGPT in Undergraduate Students' Collaborative Interdisciplinary Learning

Gaoxia Zhu,Xiuyi Fan,Chenyu Hou,Tianlong Zhong,Peter Seow,Annabel Chen Shen-Hsing,Preman Rajalingam,Low Kin Yew,Tan Lay Poh

2023-05-23

Abstract:ChatGPT, launched in November 2022, has gained widespread attention from students and educators globally, with an online report by Hu (2023) stating it as the fastest-growing consumer application in history. While discussions on the use of ChatGPT in higher education are abundant, empirical studies on its impact on collaborative interdisciplinary learning are rare. To investigate its potential, we conducted a quasi-experimental study with 130 undergraduate students (STEM and non-STEM) learning digital literacy with or without ChatGPT over two weeks. Weekly surveys were conducted on collaborative interdisciplinary problem-solving, physical and cognitive engagement, and individual reflections on ChatGPT use. Analysis of survey responses showed significant main effects of topics on collaborative interdisciplinary problem-solving and physical and cognitive engagement, a marginal interaction effect between disciplinary backgrounds and ChatGPT conditions for cognitive engagement, and a significant interaction effect for physical engagement. Sentiment analysis of student reflections suggested no significant difference between STEM and non-STEM students' opinions towards ChatGPT. Qualitative analysis of reflections generated eight positive themes, including efficiency, addressing knowledge gaps, and generating human-like responses, and eight negative themes, including generic responses, lack of innovation, and counterproductive to self-discipline and thinking. Our findings suggest that ChatGPT use needs to be optimized by considering the topics being taught and the disciplinary backgrounds of students rather than applying it uniformly. These findings have implications for both pedagogical research and practices.

Computers and Society,Artificial Intelligence

What problem does this paper attempt to address?

This paper primarily explores the application and impact of ChatGPT in collaborative interdisciplinary learning among undergraduate students. The study employs a quasi-experimental design to examine the use or non-use of ChatGPT by 130 undergraduates from different disciplinary backgrounds (STEM and non-STEM) over a two-week period while learning about two topics: Artificial Intelligence (AI) and Blockchain. The specific objectives of the study include:

1. **How do different disciplinary backgrounds, ChatGPT usage, and learning topics influence students' collaborative interdisciplinary learning abilities, physical engagement, and cognitive engagement?**
2. **Are there differences in attitudes between STEM and non-STEM students when using ChatGPT for collaborative interdisciplinary learning? What positive and negative themes can be extracted from students' reflections?**

The study employed various data collection methods, including weekly surveys to assess students' collaborative interdisciplinary learning abilities and engagement, as well as requiring students to write reflections after each session. These reflections were used for sentiment analysis and qualitative analysis to identify themes of positive and negative attitudes towards using ChatGPT.

The results indicate that the use of ChatGPT has a certain positive impact on students' learning outcomes, but its effectiveness is influenced by the topics being taught and the students' disciplinary backgrounds. Specifically, ChatGPT helps improve learning efficiency and fill knowledge gaps, but there are also some negative impacts, such as the generated answers being too generic and lacking innovation. Additionally, the study found differences in cognitive engagement between STEM and non-STEM students under different learning topics, and the effectiveness of ChatGPT usage needs to be adjusted and optimized based on specific circumstances.

In summary, this paper aims to explore the potential application of ChatGPT as an auxiliary tool in higher education, particularly in promoting students' collaborative interdisciplinary learning. Through empirical research, the authors provide insights into how to effectively integrate ChatGPT into teaching practices.