Abstract:This study enhances the generalization ability and recognition accuracy of convolutional neural networks (CNNs) in educational settings, particularly in the task of Facial Expression Recognition (FER), to support effective analysis of classroom teaching behaviors. A novel multimodal teaching behavior analysis model is proposed to achieve this goal, combining the Adaptive Deep Convolutional Neural Network (ADCNN), an Adaptive Entropy Minimization algorithm, and Transfer Learning. The aim is to improve teaching quality through more precise behavior recognition. A Bayesian Network based on a Hybrid Deep Restricted Boltzmann Machine is introduced to enhance the model's performance, enabling effective processing and analysis of multimodal data. The model's performance in the FER task has been extensively validated through experiments, encompassing precise analysis of training and testing data. These methods allow the model to adapt to different datasets automatically and improve overall performance. In addition, the study collects data on classroom engagement and learning interest from Chinese university students through questionnaires, further supporting the model's application in real educational environments. Experimental results show that the proposed model performs exceptionally well in the FER task, with an average training precision of approximately 99.79% and a testing precision of about 99.60%. The maximum difference between training and testing precision is 0.19%. The questionnaire results reveal issues such as low English proficiency and insufficient classroom engagement among students at Heilongjiang Bayi Agricultural University, providing data to support the improvement of teaching methods. The proposed multimodal teaching behavior analysis model provides an effective tool for optimizing classroom teaching by accurately recognizing students' facial expressions and classroom behaviors.

Collaboration Analysis Using Deep Learning

Privacy-Preserving Collaborative Deep Learning with Unreliable Participants.

A Machine Learning Approach to Assess Student Group Collaboration Using Individual Level Behavioral Cues

Deep neural networks for collaborative learning analytics: Evaluating team collaborations using student gaze point prediction

An Attention-Based Deep Learning Approach for Inertial Motion Recognition and Estimation in Human-Robot Collaboration

Automatic Coding of Collective Creativity Dialogues in Collaborative Problem Solving Based on Deep Learning Models.

Analysis of English classroom teaching behavior and strategies under adaptive deep learning under cognitive psychology

Learning Behavior Analysis in Classroom Based on Deep Learning

Joint gaze estimation and facial expression for student engagement prediction in collaborative learning

MDNN: Predicting Student Engagement Via Gaze Direction and Facial Expression in Collaborative Learning

Harnessing Transparent Learning Analytics for Individualized Support through Auto-detection of Engagement in Face-to-Face Collaborative Learning

An Analytic End-to-End Deep Learning Algorithm based on Collaborative Learning

An Electromyography Signals-Based Human-Robot Collaboration Method for Human Skill Learning and Imitation

Deep Collaborative Learning for Visual Recognition.

Long-term Human Participation Assessment In Collaborative Learning Environments Using Dynamic Scene Analysis

A Review on the Effectiveness of Machine Learning and Deep Learning Algorithms for Collaborative Robot

Collaborative Perception in Autonomous Driving: Methods, Datasets and Challenges

Research on Human-Machine Task Collaboration Based on Action Recognition

Towards Explainable Student Group Collaboration Assessment Models Using Temporal Representations of Individual Student Roles

Two Body Problem: Collaborative Visual Task Completion