Abstract:Contribution: This research explores the benefits and challenges of developing, deploying, and evaluating a large language models (LLMs) chatbot, MoodleBot, in computer science classroom settings. It highlights the potential of integrating LLMs into LMSs like Moodle to support self-regulated learning (SRL) and help-seeking behavior. Background: Computer science educators face immense challenges incorporating novel tools into LMSs to create a supportive and engaging learning environment. MoodleBot addresses this challenge by offering an interactive platform for both students and teachers. Research Questions: Despite issues like bias, hallucinations, and teachers’ and educators’ resistance to embracing new (AI) technologies, this research investigates two questions: (RQ1) To what extent do students accept MoodleBot as a valuable tool for learning support? (RQ2) How accurately does MoodleBot churn out responses, and how congruent are these with the established course content? Methodology: This study reviews pedagogical literature on AI-driven chatbots and adopts the retrieval-augmented generation (RAG) approach for MoodleBot’s design and data processing. The technology acceptance model (TAM) evaluates user acceptance through constructs like perceived usefulness (PU) and Ease of Use. Forty-six students participated, with 30 completing the TAM questionnaire. Findings: LLM-based chatbots like MoodleBot can significantly improve the teaching and learning process. This study revealed a high accuracy rate (88%) in providing course-related assistance. Positive responses from students attest to the efficacy and applicability of AI-driven educational tools. These findings indicate that educational chatbots are suitable for integration into courses to improve personalized learning and reduce teacher administrative burden, although improvements in automated fact-checking are needed.

Towards the Exploitation of LLM-based Chatbot for Providing Legal Support to Palestinian Cooperatives

ArabLegalEval: A Multitask Benchmark for Assessing Arabic Legal Knowledge in Large Language Models

Supporting Student Decisions on Learning Recommendations: An LLM-Based Chatbot with Knowledge Graph Contextualization for Conversational Explainability and Mentoring

Building a Legal Dialogue System: Development Process, Challenges and Opportunities

Synergizing LLMs and Knowledge Graphs: A Novel Approach to Software Repository-Related Question Answering

An LLM-Driven Chatbot in Higher Education for Databases and Information Systems

Leveraging LLM: Implementing an Advanced AI Chatbot for Healthcare

Experimenting with Legal AI Solutions: The Case of Question-Answering for Access to Justice

Intention and Context Elicitation with Large Language Models in the Legal Aid Intake Process

LLM-based Smart Reply (LSR): Enhancing Collaborative Performance with ChatGPT-mediated Smart Reply System

The Challenges of Evaluating LLM Applications: An Analysis of Automated, Human, and LLM-Based Approaches

ASHABot: An LLM-Powered Chatbot to Support the Informational Needs of Community Health Workers

Development of a Legal Document AI-Chatbot

Beyond Code Generation: An Observational Study of ChatGPT Usage in Software Engineering Practice

Design and Implementation of a Chatbot for Automated Legal Assistance using Natural Language Processing and Machine Learning

Chatlaw: A Multi-Agent Collaborative Legal Assistant with Knowledge Graph Enhanced Mixture-of-Experts Large Language Model

Generative Conversational AI And Academic Integrity: A Mixed Method Investigation To Understand The Ethical Use of LLM Chatbots In Higher Education

Towards Optimizing and Evaluating a Retrieval Augmented QA Chatbot using LLMs with Human in the Loop

ALJP: An Arabic Legal Judgment Prediction in Personal Status Cases Using Machine Learning Models

Can ChatGPT Perform Reasoning Using the IRAC Method in Analyzing Legal Scenarios Like a Lawyer?