Utilizing ChatGPT in a Data Structures and Algorithms Course: A Teaching Assistant's Perspective

Pooriya Jamie,Reyhaneh Hajihashemi,Sharareh Alipour
2024-10-11
Abstract:Integrating large language models (LLMs) like ChatGPT is revolutionizing the field of computer science education. These models offer new possibilities for enriching student learning and supporting teaching assistants (TAs) in providing prompt feedback and supplementary learning resources. This research delves into the use of ChatGPT in a data structures and algorithms (DSA) course, particularly when combined with TA supervision. The findings demonstrate that incorporating ChatGPT with structured prompts and active TA guidance enhances students' understanding of intricate algorithmic concepts, boosts engagement, and elevates academic performance. However, challenges exist in addressing academic integrity and the limitations of LLMs in tackling complex problems. The study underscores the importance of active TA involvement in reducing students' reliance on AI-generated content and amplifying the overall educational impact. The results suggest that while LLMs can be advantageous for education, their successful integration demands continuous oversight and a thoughtful balance between AI and human guidance.
Human-Computer Interaction,Artificial Intelligence,Data Structures and Algorithms
What problem does this paper attempt to address?
### What problem does this paper attempt to solve? This paper explores how to enhance student learning outcomes and exam preparation in Data Structures and Algorithms (DSA) courses by combining the supervision of teaching assistants (TAs) with the use of large language models (LLMs), particularly ChatGPT. Specifically, the paper aims to address the following issues: 1. **Impact of ChatGPT on student learning and exam preparation**: - Investigate how ChatGPT, under TA supervision, affects students' understanding and exam performance. - Evaluate whether ChatGPT can improve student engagement and academic performance. 2. **Challenges in using ChatGPT to answer DSA questions**: - Explore the limitations of ChatGPT in handling complex and visual tasks. - Analyze how active guidance from TAs can reduce students' over-reliance on AI-generated content. 3. **How different versions of ChatGPT (4o and o1) overcome limitations and support student learning**: - Study the performance of ChatGPT-4o and ChatGPT o1 in different tasks and how they complement each other to enhance student learning outcomes. - Propose how to optimize the use of ChatGPT through structured prompts and TA supervision. ### Main contributions of the paper - **Practical integration**: Investigated how to combine ChatGPT with TA supervision in actual teaching to address common challenges in DSA courses, such as students' over-reliance on AI-generated content and incomplete understanding of materials. - **Methodological innovation**: Ensured active student engagement in the learning process through structured prompts and continuous feedback, rather than passive acceptance of AI answers. - **Multi-version application**: Demonstrated how different versions of ChatGPT-4o and ChatGPT o1 can work together to improve students' understanding and problem-solving abilities. ### Methodology - **Experimental design**: Conducted an experiment with 40 undergraduate students at a top university, divided into two groups: one using ChatGPT under TA supervision and the other relying solely on TA support. - **Evaluation metrics**: Assessed learning outcomes through student satisfaction surveys, exam scores, problem-solving abilities, and engagement in classroom activities. - **Real-time adjustments**: Established a feedback loop with weekly discussions between students and the research team to identify issues and improvement directions, continuously optimizing teaching methods. ### Results - **Student performance analysis**: Students using ChatGPT under TA supervision performed better in assignments and exams, especially in solving complex problems. - **Limitations of ChatGPT**: ChatGPT has limitations in handling advanced algorithms, time complexity analysis, and visualizing graphs and trees, requiring TA supplementation and support. - **Different versions of ChatGPT**: The combined use of ChatGPT-4o and ChatGPT o1 significantly improved students' understanding of complex algorithms and problem-solving abilities, enhancing the overall learning experience. Overall, this paper demonstrates through empirical research that combining TA supervision with the use of ChatGPT in DSA courses can effectively enhance student learning outcomes, while also highlighting the limitations of ChatGPT in certain areas and proposing corresponding solutions.