Abstract:In this paper, we empirically examine and assess the effectiveness of a chatbot workshop as experiential teaching and learning tool to engage undergraduate students enrolled in an elective course "Doing Business with A.I." in the Lee Kong Chian School of Business (LKCSB) at Singapore Management University. The chatbot workshop provides non-STEM students with an opportunity to acquire basic skills to build a chatbot prototype using the 'Dialogflow' program. The workshop and the experiential learning activity are designed to impart conversation and user-centric design know how and know why to students. A key didactical aspect which informs the design and flow of the chatbot workshop is that novice learners with no or very little knowledge about A.I. recognize and create the important linkage between knowledge inputs and outputs of conversational agents powered by natural language processing (NLP) so that user queries can be effectively addressed. According to the study results, 90.7% of all surveyed students (n = 43) were satisfied with the experiential learning chatbot workshop; 81.4% of the respondents felt engaged while 81.3% of the participants reported moderate to high levels of competencies (81.3%) as result of the hands-on workshop. Almost all students surveyed (97.7%) felt that the experiential chatbot workshop had met the expected learning outcomes. Besides presenting empirical data that underscore the pedagogical usefulness of conducting an experiential Chatbot workshop in basic A.I. classes with special reference to NLP, we are trying to corroborate a conceptual model developed from learning theories and technology mediated learning (TML) models aimed at measuring the effects of a chatbot practicum on students' engagement and motivation as potential drivers of successfully acquiring basic NLP skills and learner satisfaction. The paper provides useful practical information for instructors interested in deploying a practical chatbot workshop as effective TML tool in a tertiary educational context aimed at making learners 'future-ready'. Supplementary information: The online version contains supplementary material available at 10.1007/s10639-023-11795-5.

An empirical study of the efficacy of AI chatbots for English as a foreign language learning in primary education

Using AI-driven chatbots to foster Chinese EFL students' academic engagement: An intervention study

Can interaction with generative artificial intelligence enhance learning autonomy? A longitudinal study from comparative perspectives of virtual companionship and knowledge acquisition preferences

An Application Study on AI Educational Robots in Spoken English Exercises of Chinese Primary Schools

Future English Learning: Chatbots and Artificial Intelligence

EnglishBot: an AI-Powered Conversational System for Second Language Learning

Chatbots in English as a foreign or second language education contexts: A review of recent empirical research

A meta-analysis on the comparative effects of AI chatbot utilization in English education programs

Examining the Impact of Chatbot-based Language Learning Support, Adaptive Learning Algorithms, and Virtual Reality Language Immersion on EFL Learners' Language Learning Proficiency and Self-Regulated Learning Skills

The promises and challenges of AI-based chatbots in language education through the lens of learner emotions

The impact of chatbots based on large language models on second language vocabulary acquisition

A Bibliometric Analysis of Artificial Intelligence Chatbots in Language Education

Exploration of undergraduate students lived experiences of using a chatbot for English language learning

Artificial Intelligence (AI) Student Assistants in the Classroom: Designing Chatbots to Support Student Success

Conversation Technology With Micro-Learning: The Impact of Chatbot-Based Learning on Students’ Learning Motivation and Performance

An Empirical Study on the Implementation of AI Assisted Language Teaching for Improving Learner's Learning Ability

Using Adaptive Empathetic Responses for Teaching English

AI Chatbots as Multi-Role Pedagogical Agents: Transforming Engagement in CS Education

Assessing the effectiveness of a chatbot workshop as experiential teaching and learning tool to engage undergraduate students

Investigation of the Influence of Artificial Intelligence Markup Language-Based LINE ChatBot in Contextual English Learning

Using Chatbots to Teach Languages