An Exploratory Study on Upper-Level Computing Students' Use of Large Language Models as Tools in a Semester-Long Project

Ben Arie Tanay,Lexy Arinze,Siddhant S. Joshi,Kirsten A. Davis,James C. Davis

2024-04-17

Abstract:Background: Large Language Models (LLMs) such as ChatGPT and CoPilot are influencing software engineering practice. Software engineering educators must teach future software engineers how to use such tools well. As of yet, there have been few studies that report on the use of LLMs in the classroom. It is, therefore, important to evaluate students' perception of LLMs and possible ways of adapting the computing curriculum to these shifting paradigms.

Software Engineering,Human-Computer Interaction

What problem does this paper attempt to address?

This paper discusses the experiences and approaches of senior students in software engineering education using large-scale language models (LLMs), such as ChatGPT and Copilot, in semester projects. The research aims to explore the students' integration of LLMs in their projects and how these tools impact their learning. By collecting data in a software engineering course at Purdue University, the study found that students use LLMs for programming support, creative generation, writing assistance, and project management tasks. They believe that LLMs improve efficiency but are also concerned about responsibly using LLMs to avoid negative impacts on learning outcomes. The study suggests future exploration of seamlessly integrating LLMs as learning tools in lower-level computer engineering courses.