Artificial intelligence based cognitive state prediction in an e-learning environment using multimodal data
Gupta, Swadha,Kumar, Parteek,Tekchandani, Rajkumar
DOI: https://doi.org/10.1007/s11042-023-18021-x
IF: 2.577
2024-01-17
Multimedia Tools and Applications
Abstract:The COVID-19 pandemic has significantly shifted how people learn, with virtual learning becoming the norm. Students no longer need to be physically present in a specific location to gain knowledge. This paradigm shift has led to new challenges, particularly regarding instructor feedback during e-learning sessions. Unlike traditional learning, where face-to-face interaction allows instructors to give feedback based on student's learning behaviour, the lack of such interaction in e-learning poses a challenge. To address this, two methods: a computer vision-based and EEG-based, are used in the present work to monitor a student's cognitive behaviour during e-learning sessions. The former involves using a webcam to capture facial cues, such as facial expressions, eye blinks, and head movements, while the latter requires using an EEG device, such as the Neurosky wireless device, to record EEG waves. By collecting and analysing this data, teachers can identify students struggling in the e-learning environment. This paper explores using facial cues and EEG signals to predict a student's cognitive behaviour in the form of attentiveness or inattentiveness throughout the e-learning sessions. The experimental results achieved an accuracy of 92.33% using facial cues, while the accuracy achieved using EEG was 91.68%. Overall, efficient detection of students' learning situations can help teachers to create a more responsive and effective e-learning environment that meets the needs of all students.
computer science, information systems, theory & methods,engineering, electrical & electronic, software engineering