Abstract:This study enhances the generalization ability and recognition accuracy of convolutional neural networks (CNNs) in educational settings, particularly in the task of Facial Expression Recognition (FER), to support effective analysis of classroom teaching behaviors. A novel multimodal teaching behavior analysis model is proposed to achieve this goal, combining the Adaptive Deep Convolutional Neural Network (ADCNN), an Adaptive Entropy Minimization algorithm, and Transfer Learning. The aim is to improve teaching quality through more precise behavior recognition. A Bayesian Network based on a Hybrid Deep Restricted Boltzmann Machine is introduced to enhance the model's performance, enabling effective processing and analysis of multimodal data. The model's performance in the FER task has been extensively validated through experiments, encompassing precise analysis of training and testing data. These methods allow the model to adapt to different datasets automatically and improve overall performance. In addition, the study collects data on classroom engagement and learning interest from Chinese university students through questionnaires, further supporting the model's application in real educational environments. Experimental results show that the proposed model performs exceptionally well in the FER task, with an average training precision of approximately 99.79% and a testing precision of about 99.60%. The maximum difference between training and testing precision is 0.19%. The questionnaire results reveal issues such as low English proficiency and insufficient classroom engagement among students at Heilongjiang Bayi Agricultural University, providing data to support the improvement of teaching methods. The proposed multimodal teaching behavior analysis model provides an effective tool for optimizing classroom teaching by accurately recognizing students' facial expressions and classroom behaviors.

An FFM-based Model for Students' In-class Learning Postures Estimation

Online Classroom Teaching Quality Evaluation System Based on Facial Feature Recognition

Classroom Student Posture Recognition Based on an Improved High-Resolution Network.

A Method for Analyzing Learning Sentiment Based on Classroom Time-Series Images

A Student Facial Expression Recognition Model Based on Multi-Scale and Deep Fine-Grained Feature Attention Enhancement

Intelligent Education Managemnt System Design for Universities based on MTCNN Face Recognition Algorithm

Calculation of the Rate of Taking Lessons Based on Face Recognition and Head Pose Estimation

Online Learning State Evaluation Method Based on Face Detection and Head Pose Estimation

A Teaching Evaluation System Based On Visual Recognition Technology

Multimodal Learning Engagement Assessment System: An Innovative Approach to Optimizing Learning Engagement

Analysis on the innovative education mode of the integration of information technology and traditional teaching in the era of big data

An English video teaching classroom attention evaluation model incorporating multimodal information

A Teacher and Student Facial Expression Recognition Model Based on Classroom Teaching Videos

Learning State Assessment in Online Education Based on Multiple Facial Features Detection

Simulation of English classroom effectiveness based on human-computer interaction and facial identification

Analysis of English classroom teaching behavior and strategies under adaptive deep learning under cognitive psychology

Evaluation of Online Teaching Quality Based on Facial Expression Recognition

Higher education management work based on information fusion technology for the development of innovation ability of college students

Automatic Attendance Face Recognition for Real Classroom Environments

Student Sentiment Analysis and Classroom Feedback Prediction Using Deep Learning

Recognition of classroom student state features based on deep learning algorithms and machine learning