Abstract:In the realm of education, feedback emerges as a pivotal component, serving to foster engagement and interaction while also facilitating the refinement of teaching methods to capture and maintain student attention. Traditional classroom assessment methods often struggle to accurately gauge the degree of comprehension among students during lectures, relying on manual comment collection that inherently carries the risk of inaccuracies. In response to this challenge, a novel system has been proposed, harnessing the power of Facial Emotion Recognition (FER) technology to capture student feedback. Within this framework, students are given a unique avenue to convey their emotions and reactions, employing facial expressions and gestures as the means to communicate. This innovative approach enables the analysis of students' emotional responses and thereby provides invaluable insights into their comprehension levels, as well as the overall quality and engagement experienced during lectures. The approach takes shape through the utilization of Computer Vision techniques, with a particular focus on an unobtrusive methodology for assessing students' overall engagement. Overcoming limitations of traditional assessment, our approach integrates compound scaling, employing the proposed Multitask EfficientNetB0 model recognized for its proved accuracy in emotion recognition (95.7%) and behavior analysis (96.3%) across diverse datasets (DAiSEE, iSED, iSAFFE). The behavioral classification system categorizes students into "Engaged" and "Disengaged" classes within a multi-class framework, providing nuanced insights into comprehension and Student engagement. Assessment metrics, including ROC Curves, Precision, Recall, and F1-Score, ensure a thorough evaluation. Our system's adaptability is demonstrated across varied educational environments, showcasing real-world efficacy in classrooms, laboratories, and seminar halls. The inclusion of MTCNN enhances face detection capabilities, facilitating robust analysis in dynamic scenarios. Expanding its applicability, the model has been put to the test in a range of educational settings, including classrooms, laboratory environments, and seminar halls, offering dual-capability analysis of both emotions and behavior. This comprehensive approach yields nuanced insights into student engagement and interaction, and its performance has been validated through real-world deployment within classrooms and seminars

Improved ECA-ResTCN for Online Classroom Student Attention Recognition

Engagement Detection in Online Learning Based on Pre-trained Vision Transformer and Temporal Convolutional Network

Improving state-of-the-art in Detecting Student Engagement with Resnet and TCN Hybrid Network

A novel parameter dense three-dimensional convolution residual network method and its application in classroom teaching

Multitask EfficientNet affective computing for student engagement detection

An English video teaching classroom attention evaluation model incorporating multimodal information

Learner Attentiveness and Engagement Analysis in Online Education Using Computer Vision

Student engagement detection in online environment using computer vision and multi-dimensional feature fusion

An Effective Teacher Behavior Recognition Method Based on Teaching-focused Regions Extraction and TeacherMask Data Augmentation

Classroom Attention Estimation Method Based on Mining Facial Landmarks of Students

Spatio-temporal Attention Network for Student Action Recognition in Classroom Teaching Videos

A Classroom Students Convergent Behavior Analysis System Based on Image Recognition

Student Learning Behavior Recognition Incorporating Data Augmentation with Learning Feature Representation in Smart Classrooms

Learning Deep Spatiotemporal Feature for Engagement Recognition of Online Courses

Multi-view and multi-scale behavior recognition algorithm based on attention mechanism

Evaluation of Online Teaching Quality Based on Facial Expression Recognition

Analysis of English classroom teaching behavior and strategies under adaptive deep learning under cognitive psychology

An intelligent system for monitoring students' engagement in large classroom teaching through facial expression recognition

Engagement Recognition in Online Learning Based on an Improved Video Vision Transformer

Dual Multi-Task Network with Bridge-Temporal-Attention for Student Emotion Recognition Via Classroom Video

STRAN: Student expression recognition based on spatio-temporal residual attention network in classroom teaching videos