Abstract:With the rapid development of artificial intelligence technology, the exploration and application in the field of intelligent education has become a research hotspot of increasing concern. In the actual classroom scenarios, students' classroom behavior is an important factor that directly affects their learning performance. Specifically, students with poor self-management abilities, particularly specific developmental disorders, may face educational and academic difficulties owing to physical or psychological factors. Therefore, the intelligent perception and identification of school-aged children's classroom behaviors are extremely valuable and significant. The traditional method for identifying students' classroom behavior relies on statistical surveys conducted by teachers, which incurs problems such as being time-consuming, labor-intensive, privacy-violating, and an inaccurate manual intervention. To address the above-mentioned issues, we constructed a motion sensor-based intelligent system to realize the perception and identification of classroom behavior in the current study. For the acquired sensor signal, we proposed a Voting-Based Dynamic Time Warping algorithm (VB-DTW) in which a voting mechanism is used to compare the similarities between adjacent clips and extract valid action segments. Subsequent experiments have verified that effective signal segments can help improve the accuracy of behavior identification. Furthermore, upon combining with the classroom motion data acquisition system, through the powerful feature extraction ability of the deep learning algorithms, the effectiveness and feasibility are verified from the perspectives of the dimensional signal characteristics and time series separately so as to realize the accurate, non-invasive and intelligent children's behavior detection. To verify the feasibility of the proposed method, a self-constructed dataset (SCB-13) was collected. Thirteen participants were invited to perform 14 common class behaviors, wearing motion sensors whose data were recorded by a program. In SCB-13, the proposed method achieved 100% identification accuracy. Based on the proposed algorithms, it is possible to provide immediate feedback on students' classroom performance and help them improve their learning performance while providing an essential reference basis and data support for constructing an intelligent digital education platform.

A database of students’ spontaneous actions in the real classroom environment

Student Action Recognition Based on Multiple Features

Student behavior recognition for interaction detection in the classroom environment

A Study of Classroom Behavior Recognition Incorporating Super-Resolution and Target Detection

Student Activity Recognition in Classroom Environments using Transfer Learning

Student Classroom Behavior Detection based on Spatio-Temporal Network and Multi-Model Fusion

An intelligent system for monitoring students' engagement in large classroom teaching through facial expression recognition

Learning Behavior Recognition in Smart Classroom with Multiple Students Based on YOLOv5

Automated Student Classroom Behaviors' Perception and Identification Using Motion Sensors

Towards Student Actions in Classroom Scenes: New Dataset and Baseline

Research on the Evaluation of Moral Education Effectiveness and Student Behavior in Universities under the Environment of Big Data

Behavior Recognition of College Students Based on Improved Deep Learning Algorithm

STRAN: Student expression recognition based on spatio-temporal residual attention network in classroom teaching videos

A novel parameter dense three-dimensional convolution residual network method and its application in classroom teaching

Real-time microexpression recognition in educational scenarios using a dual-branch continuous attention network

Deep Visual Computing of Behavioral Characteristics in Complex Scenarios and Embedded Object Recognition Applications

Student Learning Behavior Recognition Incorporating Data Augmentation with Learning Feature Representation in Smart Classrooms

A simple teacher behavior recognition method for massive teaching videos based on teacher set

Framework for Detecting Student Behaviour (Nail Biting, Sleep, and Yawn) Using Deep Learning Algorithm

Student Behavior Recognition System for the Classroom Environment Based on Skeleton Pose Estimation and Person Detection

Teacher–Student Behavior Recognition in Classroom Teaching Based on Improved YOLO-v4 and Internet of Things Technology