Abstract:In the realm of education, feedback emerges as a pivotal component, serving to foster engagement and interaction while also facilitating the refinement of teaching methods to capture and maintain student attention. Traditional classroom assessment methods often struggle to accurately gauge the degree of comprehension among students during lectures, relying on manual comment collection that inherently carries the risk of inaccuracies. In response to this challenge, a novel system has been proposed, harnessing the power of Facial Emotion Recognition (FER) technology to capture student feedback. Within this framework, students are given a unique avenue to convey their emotions and reactions, employing facial expressions and gestures as the means to communicate. This innovative approach enables the analysis of students' emotional responses and thereby provides invaluable insights into their comprehension levels, as well as the overall quality and engagement experienced during lectures. The approach takes shape through the utilization of Computer Vision techniques, with a particular focus on an unobtrusive methodology for assessing students' overall engagement. Overcoming limitations of traditional assessment, our approach integrates compound scaling, employing the proposed Multitask EfficientNetB0 model recognized for its proved accuracy in emotion recognition (95.7%) and behavior analysis (96.3%) across diverse datasets (DAiSEE, iSED, iSAFFE). The behavioral classification system categorizes students into "Engaged" and "Disengaged" classes within a multi-class framework, providing nuanced insights into comprehension and Student engagement. Assessment metrics, including ROC Curves, Precision, Recall, and F1-Score, ensure a thorough evaluation. Our system's adaptability is demonstrated across varied educational environments, showcasing real-world efficacy in classrooms, laboratories, and seminar halls. The inclusion of MTCNN enhances face detection capabilities, facilitating robust analysis in dynamic scenarios. Expanding its applicability, the model has been put to the test in a range of educational settings, including classrooms, laboratory environments, and seminar halls, offering dual-capability analysis of both emotions and behavior. This comprehensive approach yields nuanced insights into student engagement and interaction, and its performance has been validated through real-world deployment within classrooms and seminars

Recognizing Multidimensional Engagement of E-Learners Based on Multi-Channel Data in E-Learning Environment.

Learning Unit State Recognition Based on Multi-channel Data Fusion

Multimodal Engagement Recognition From Image Traits Using Deep Learning Techniques

Design of an Online Education Evaluation System Based on Multimodal Data of Learners.

Student engagement detection in online environment using computer vision and multi-dimensional feature fusion

Student Engagement Detection Using Emotion Analysis, Eye Tracking and Head Movement with Machine Learning

Learner Attentiveness and Engagement Analysis in Online Education Using Computer Vision

A multimodal facial cues based engagement detection system in e-learning context using deep learning approach

An Integrated Observing Technic for Collaborative Learning: The Multimodal Learning Analytics Based on the Video Coding and EEG Data Mining

Facial Expression Recognition for Probing Students’ Emotional Engagement in Science Learning

Data-driven Online Learning Engagement Detection via Facial Expression and Mouse Behavior Recognition Technology

Multitask EfficientNet affective computing for student engagement detection

A Multimodal Intelligent Emotion Perception Framework by Data-driven and Knowledge-guided

Integrating Gaze and Mouse Via Joint Cross-Attention Fusion Net for Students’ Activity Recognition in E-learning

Multimodal Engagement Analysis from Facial Videos in the Classroom

Learning State Assessment in Online Education Based on Multiple Facial Features Detection

A Framework for MOOC Learning Assessment Based on Facial Expression Driven by Knowledge Contextual Awareness

A Real-Time Learning Analytics Dashboard for Automatic Detection of Online Learners' Affective States

Multimodal Learning Engagement Assessment System: An Innovative Approach to Optimizing Learning Engagement

Joint gaze estimation and facial expression for student engagement prediction in collaborative learning

A Method of Multimodal Emotion Recognition in Video Learning Based on Knowledge Enhancement