Abstract:This paper investigates the tensions introduced by the introduction of large language model (LLM)-based chatbots in higher education, particularly within a distance university that embraces a networked learning approach. LLM-based chatbots such as ChatGPT are applications that simulate conversations with humans, powered by AI-trained large language models. The study is grounded in a socio-material perspective, considering the digital as inherently intertwined with social, material, and broader contextual factors. Utilising cultural-historical activity theory (CHAT) as a framework, the research examines the changing human-technology relationship and the emerging tensions within the learning activity system.A survey conducted in Spring 2023 at OnlineUni (name changed) revealed that while students appreciate the immediate, personalised responses from LLM-based chatbots, there is significant distrust in the output, and they raised concerns about the quality of learning and the value of their diplomas. Teachers share these concerns and question the evolving roles and responsibilities in education due to such chatbots. The survey, which included responses from 584 students and 171 teachers, highlighted the use of LLM-based chatbots for various purposes, such as obtaining quick answers to generating content, and underscored the need for support in integrating them into learning and professional activities.The CHAT framework allows for an analysis of the activity system, identifying tensions in tool mediation, division of labour, and rules. Students are grappling with the balance between human and AI contributions to learning, the potential for chatbots to undermine the learning process, and the need for clear guidelines on using these technologies. The paper discusses the implications of these tensions on the learning objectives, the role of the community, and the division of labour within the educational setting.The findings suggest that the introduction of LLM-based chatbots is forcing a re-evaluation of what should be taught and how learning could be facilitated. There is a call for critical AI literacy and a better understanding of the redefinition of the division of labour between students, AI, and the community. The study highlights the necessity for collaborative rule-making to navigate the complexities of integrating LLM-based chatbots into higher education, ensuring fairness and accessibility while maintaining the quality of learning.In conclusion, the paper emphasises the need for ongoing research to understand the evolving dynamics of human and non-human actors in the learning process. It calls for a closer examination of the interactions within the learning activity system, particularly the instrumental genesis of student-tool relationships, to inform the development of pedagogical strategies that leverage the capabilities of LLM-based chatbots without compromising the collaborative values of education.

LLM examiner: automating assessment in informal self-directed e-learning using ChatGPT

Assessing the Usability of ChatGPT for Formal English Language Learning

ChatGPT versus engineering education assessment: a multidisciplinary and multi-institutional benchmarking and analysis of this generative artificial intelligence tool to investigate assessment integrity

A Cross-Disciplinary Examination of the Instructional Uses of ChatGPT in Higher Education

Towards LLM-based Autograding for Short Textual Answers

Automatic assessment of text-based responses in post-secondary education: A systematic review

An LLM-Driven Chatbot in Higher Education for Databases and Information Systems

AI-generated feedback on writing: insights into efficacy and ENL student preference

Impact of ChatGPT on Academic Integrity and Assessment Effectiveness for E-learning in Higher Education: The Need for Redesigning Assessment Practices

Could ChatGPT get an Engineering Degree? Evaluating Higher Education Vulnerability to AI Assistants

Role-Playing Simulation Games using ChatGPT

Application of Large Language Models in Automated Question Generation: A Case Study on ChatGLM's Structured Questions for National Teacher Certification Exams

chatGPT for generating questions and assessments based on accreditations

Is AI changing learning and assessment as we know it? Evidence from a ChatGPT experiment and a conceptual framework

Generative Artificial Intelligence in Higher Education: Exploring Ways of Harnessing Pedagogical Practices with the Assistance of ChatGPT

Empowering Language Learners’ Critical Thinking: Evaluating ChatGPT’s Role in English Course Implementation

AI and Chat GPT in Language Teaching: Enhancing EFL Classroom Support and Transforming Assessment Techniques

ChatGPT as a Solver and Grader of Programming Exams written in Spanish

Befriending ChatGPT and other superchatbots: An AI-integrated take-home assessment preserving integrity

Economic and Financial Learning with Artificial Intelligence: A Mixed-Methods Study on ChatGPT

Emerging tensions around learning with LLM-based chatbots