Abstract:With the development of multimedia technologies, surveillance videos and other multimedia data have received widespread attention in several fields. Surveillance videos can monitor students' learning statuses in real time. However, the current action recognition methods for teaching have limitations. First, the ethical privacy of AI and education makes public datasets on student behavior scarce. Therefore, based on the summarization of seven typical student behaviors in the classroom, course videos were obtained from the smart classroom to generate a dataset of student behavior. Compared with existing student behavior recognition datasets, the proposed dataset is distinguished by cluttered backgrounds, crowded scenes, and occlusions. Second, relational reasoning using existing methods is not ideal for distinguishing between students' body parts and small objects in a cluttered background; the interactive utilization rate of different relational features is low, and it cannot take advantage of the complementarity of different relational features, resulting in poor performance of interaction action recognition. Therefore, the attention-based relational reasoning module strengthens the interactive representation between small objects and human body parts. At the same time, considering that there is a certain complementary relationship between relational features, this study constructs a relational feature fusion module which models a human-to-human interaction relationship built upon supporting human's body part and surrounding context. Finally, the reconstructed features and human-appearance features were fused to achieve accurate interactive action recognition. Through an experimental comparison between the proposed and current mainstream algorithms on the generated student behavior dataset, it was verified that the proposed model achieves state-of-the-art performance in action recognition.

Student Activity Recognition in Classroom Environments using Transfer Learning

Student behavior recognition for interaction detection in the classroom environment

A Database of Students' Actions Based on Real Classroom Environment

A Students' Action Recognition Database In Smart Classroom

A Study of Classroom Behavior Recognition Incorporating Super-Resolution and Target Detection

XLearn

Multimodal behavior analysis in computer-enabled laboratories using nonverbal cues

An intelligent system for monitoring students' engagement in large classroom teaching through facial expression recognition

Student Recognition and Activity Monitoring in E-Classes Using Deep Learning in Higher Education

Indoor Scene Recognition: An Attention-Based Approach Using Feature Selection-Based Transfer Learning and Deep Liquid State Machine

A recent survey for human activity recoginition based on deep learning approach

Classroom Learning Status Assessment Based on Deep Learning

Classroom Student Emotions Classification from Facial Expressions and Speech Signals using Deep Learning

Learning Behavior Analysis in Classroom Based on Deep Learning

Human activity recognition using deep learning approaches and single frame cnn and convolutional lstm

Prediction and Localization of Student Engagement in the Wild

Behavior Recognition of Teachers and Students in the Smart Classroom Based on Deep Learning

A database of students’ spontaneous actions in the real classroom environment

Learning Behavior Recognition in Smart Classroom with Multiple Students Based on YOLOv5

EduNet: A New Video Dataset for Understanding Human Activity in the Classroom Environment

Auto Deep Learning-based Automated Surveillance Technique to Recognize the Activities in the Cyber-Physical System