I don't trust you (anymore)! -- The effect of students' LLM use on Lecturer-Student-Trust in Higher Education

Simon Kloker,Matthew Bazanya,Twaha Kateete

2024-06-21

Abstract:Trust plays a pivotal role in Lecturer-Student-Collaboration, encompassing teaching and research aspects. The advent of Large Language Models (LLMs) in platforms like Open AI's ChatGPT, coupled with their cost-effectiveness and high-quality results, has led to their rapid adoption among university students. However, discerning genuine student input from LLM-generated output poses a challenge for lecturers. This dilemma jeopardizes the trust relationship between lecturers and students, potentially impacting university downstream activities, particularly collaborative research initiatives. Despite attempts to establish guidelines for student LLM use, a clear framework mutually beneficial for lecturers and students in higher education remains elusive. This study addresses the research question: How does the use of LLMs by students impact Informational and Procedural Justice, influencing Team Trust and Expected Team Performance? Methodically, we applied a quantitative construct-based survey, evaluated using techniques of Structural Equation Modelling (PLS- SEM) to examine potential relationships among these constructs. Our findings based on 23 valid respondents from Ndejje University indicate that lecturers are less concerned about the fairness of LLM use per se but are more focused on the transparency of student utilization, which significantly influences Team Trust positively. This research contributes to the global discourse on integrating and regulating LLMs and subsequent models in education. We propose that guidelines should support LLM use while enforcing transparency in Lecturer-Student- Collaboration to foster Team Trust and Performance. The study contributes valuable insights for shaping policies enabling ethical and transparent LLMs usage in education to ensure effectiveness of collaborative learning environments.

Computers and Society,Artificial Intelligence,Emerging Technologies,Human-Computer Interaction,Machine Learning

What problem does this paper attempt to address?

The paper attempts to address the impact of students' use of large language models (LLMs) on the trust relationship between lecturers and students in higher education. Specifically, the paper explores the following aspects:

1. **Impact of Students' Use of LLMs**: With the widespread use of LLMs such as ChatGPT among students, distinguishing between students' own work and content generated by LLMs has become a challenge. This directly affects lecturers' assessment and trust in students' work.

2. **Role of Informational Justice and Procedural Justice**: The paper examines the mediating role of informational justice and procedural justice between students' use of LLMs and team trust. Informational justice refers to the transparency and sharing of information, while procedural justice involves the fairness in the process of evaluating and handling students' use of LLMs.

3. **Relationship Between Team Trust and Expected Team Performance**: The paper explores how students' use of LLMs affects team trust and how this change in trust further impacts the expected team performance.

4. **Necessity of Formulating Guidelines**: The paper aims to provide empirical evidence for formulating reasonable guidelines for the use of LLMs to ensure their reasonable and transparent use in educational environments. This is to maintain the trust relationship between lecturers and students and to promote an effective collaborative learning environment.

Overall, the paper hopes to explore the specific impact of students' use of LLMs on the trust relationship between lecturers and students through quantitative research methods, particularly structural equation modeling (PLS-SEM), and to propose corresponding policy recommendations.