Abstract:With the rapid development of artificial intelligence technology, the exploration and application in the field of intelligent education has become a research hotspot of increasing concern. In the actual classroom scenarios, students' classroom behavior is an important factor that directly affects their learning performance. Specifically, students with poor self-management abilities, particularly specific developmental disorders, may face educational and academic difficulties owing to physical or psychological factors. Therefore, the intelligent perception and identification of school-aged children's classroom behaviors are extremely valuable and significant. The traditional method for identifying students' classroom behavior relies on statistical surveys conducted by teachers, which incurs problems such as being time-consuming, labor-intensive, privacy-violating, and an inaccurate manual intervention. To address the above-mentioned issues, we constructed a motion sensor-based intelligent system to realize the perception and identification of classroom behavior in the current study. For the acquired sensor signal, we proposed a Voting-Based Dynamic Time Warping algorithm (VB-DTW) in which a voting mechanism is used to compare the similarities between adjacent clips and extract valid action segments. Subsequent experiments have verified that effective signal segments can help improve the accuracy of behavior identification. Furthermore, upon combining with the classroom motion data acquisition system, through the powerful feature extraction ability of the deep learning algorithms, the effectiveness and feasibility are verified from the perspectives of the dimensional signal characteristics and time series separately so as to realize the accurate, non-invasive and intelligent children's behavior detection. To verify the feasibility of the proposed method, a self-constructed dataset (SCB-13) was collected. Thirteen participants were invited to perform 14 common class behaviors, wearing motion sensors whose data were recorded by a program. In SCB-13, the proposed method achieved 100% identification accuracy. Based on the proposed algorithms, it is possible to provide immediate feedback on students' classroom performance and help them improve their learning performance while providing an essential reference basis and data support for constructing an intelligent digital education platform.

Evaluating Children’s Engagement Through Wrist-worn Biosensors and LSTM Network

Harnessing Commodity Wearable Devices to Capture Learner Engagement

Attention-based LSTM Network for Wearable Human Activity Recognition

Prediction of pediatric activity intensity with wearable sensors and bi-directional LSTM models

Learning Attention Level Prediction Via Multimodal Physiological Data Using Wearable Wrist Devices

Enhancing Screen Time Identification in Children with a Multi-View Vision Language Model and Screen Time Tracker

A hybrid deep approach to recognizing student activity and monitoring health physique based on accelerometer data from smartphones

Automated Student Classroom Behaviors' Perception and Identification Using Motion Sensors

A LSTM Network-based Learners’ Monitoring Model for Academic Self-efficacy Evaluation Using EEG Signal Analysis

Integrated Sensing and Computing for Wearable Human Activity Recognition with MEMS IMU and BLE Network

Real-time Dynamic Data Analysis Model Based on Wearable Smartband

Annotating sleep states in children from wrist-worn accelerometer data using Machine Learning

EEG-based measurement system for monitoring student engagement in learning 4.0

n-Gage: Predicting in-class Emotional, Behavioural and Cognitive Engagement in the Wild

Multimodal Learning Engagement Assessment System: An Innovative Approach to Optimizing Learning Engagement

Wearable Device-Based Real-Time Monitoring of Physiological Signals: Evaluating Cognitive Load Across Different Tasks

Sensor2Text: Enabling Natural Language Interactions for Daily Activity Tracking Using Wearable Sensors

Monitoring Student Activities with Smartwatches: On the Academic Performance Enhancement

Classifying engagement in E-learning through GRU-TCN model using photoplethysmography signals

Integrating Gaze and Mouse Via Joint Cross-Attention Fusion Net for Students’ Activity Recognition in E-learning

A Preliminary Study of the Efficacy of Using a Wrist-Worn Multiparameter Sensor for the Prediction of Cognitive Flow States in University-Level Students