Abstract:In the realm of education, feedback emerges as a pivotal component, serving to foster engagement and interaction while also facilitating the refinement of teaching methods to capture and maintain student attention. Traditional classroom assessment methods often struggle to accurately gauge the degree of comprehension among students during lectures, relying on manual comment collection that inherently carries the risk of inaccuracies. In response to this challenge, a novel system has been proposed, harnessing the power of Facial Emotion Recognition (FER) technology to capture student feedback. Within this framework, students are given a unique avenue to convey their emotions and reactions, employing facial expressions and gestures as the means to communicate. This innovative approach enables the analysis of students' emotional responses and thereby provides invaluable insights into their comprehension levels, as well as the overall quality and engagement experienced during lectures. The approach takes shape through the utilization of Computer Vision techniques, with a particular focus on an unobtrusive methodology for assessing students' overall engagement. Overcoming limitations of traditional assessment, our approach integrates compound scaling, employing the proposed Multitask EfficientNetB0 model recognized for its proved accuracy in emotion recognition (95.7%) and behavior analysis (96.3%) across diverse datasets (DAiSEE, iSED, iSAFFE). The behavioral classification system categorizes students into "Engaged" and "Disengaged" classes within a multi-class framework, providing nuanced insights into comprehension and Student engagement. Assessment metrics, including ROC Curves, Precision, Recall, and F1-Score, ensure a thorough evaluation. Our system's adaptability is demonstrated across varied educational environments, showcasing real-world efficacy in classrooms, laboratories, and seminar halls. The inclusion of MTCNN enhances face detection capabilities, facilitating robust analysis in dynamic scenarios. Expanding its applicability, the model has been put to the test in a range of educational settings, including classrooms, laboratory environments, and seminar halls, offering dual-capability analysis of both emotions and behavior. This comprehensive approach yields nuanced insights into student engagement and interaction, and its performance has been validated through real-world deployment within classrooms and seminars

TTNet: A novel machine learning model for facial emotion detection in online learning systems

Human Facial Emotion Recognition using Deep Neural Networks

CNN for Facial Emotion Recognition in Online Learning Platforms to Identify Learner Engagement

The application of deep learning in computer vision: Facial emotion recognition based on convolutional neural network

Classifying Emotions and Engagement in Online Learning Based on a Single Facial Expression Recognition Neural Network

EMONET: A Cross Database Progressive Deep Network for Facial Expression Recognition

DTL-I-ResNet18: facial emotion recognition based on deep transfer learning and improved ResNet18

Facial Expression Recognition Using Deep Neural Network

Revolutionizing online education: Advanced facial expression recognition for real-time student progress tracking via deep learning model

Deep learning-based facial emotion recognition for human–computer interaction applications

A Deep Learning-based Emotion Recognition System for Interactive E-Learning

Implementation of an adaptive E-learning platform with facial emotion recognition

Meta Transfer Learning for Facial Emotion Recognition

EmoNet: Exploring Facial Emotion Recognition Through Machine Learning

Using Facial Expression to Detect Emotion in E-learning System: A Deep Learning Method.

NAGNet: A novel framework for real‐time students' sentiment analysis in the wisdom classroom

Facial emotion recognition based real-time learner engagement detection system in online learning context using deep learning models

Multitask EfficientNet affective computing for student engagement detection

A real time face emotion classification and recognition using deep learning model

A Transfer Learning Approach for Facial Emotion Recognition Using a Deep Learning Model

Human Face Emotion in 3D Using Machine Learning