Abstract:With the development of multimedia technologies, surveillance videos and other multimedia data have received widespread attention in several fields. Surveillance videos can monitor students' learning statuses in real time. However, the current action recognition methods for teaching have limitations. First, the ethical privacy of AI and education makes public datasets on student behavior scarce. Therefore, based on the summarization of seven typical student behaviors in the classroom, course videos were obtained from the smart classroom to generate a dataset of student behavior. Compared with existing student behavior recognition datasets, the proposed dataset is distinguished by cluttered backgrounds, crowded scenes, and occlusions. Second, relational reasoning using existing methods is not ideal for distinguishing between students' body parts and small objects in a cluttered background; the interactive utilization rate of different relational features is low, and it cannot take advantage of the complementarity of different relational features, resulting in poor performance of interaction action recognition. Therefore, the attention-based relational reasoning module strengthens the interactive representation between small objects and human body parts. At the same time, considering that there is a certain complementary relationship between relational features, this study constructs a relational feature fusion module which models a human-to-human interaction relationship built upon supporting human's body part and surrounding context. Finally, the reconstructed features and human-appearance features were fused to achieve accurate interactive action recognition. Through an experimental comparison between the proposed and current mainstream algorithms on the generated student behavior dataset, it was verified that the proposed model achieves state-of-the-art performance in action recognition.

An Effective Approach to Intelligent Teaching Platform Design Using Advanced Skeleton-Based Action Recognition Algorithm

An action analysis algorithm for teachers based on human pose estimation

Shifting Perspective to See Difference: A Novel Multi-View Method for Skeleton Based Action Recognition

Online Robust Action Recognition Based on a Hierarchical Model

Student Behavior Recognition System for the Classroom Environment Based on Skeleton Pose Estimation and Person Detection

A Skeleton-based Action Recognition System for Medical Condition Detection

A Key Skeleton Points Guided Classroom Action Recognition Method Based on Multimodal Symmetry Fusion

ST-TGR: Spatio-Temporal Representation Learning for Skeleton-Based Teaching Gesture Recognition

Human action recognition in smart classroom

Three-Dimensional Action Recognition for Basketball Teaching Coupled with Deep Neural Network

Design of Sports Training Simulation System for Children Based on Improved Deep Neural Network

Elevating Skeleton-Based Action Recognition with Efficient Multi-Modality Self-Supervision

Human posture estimation and action recognition on fitness behavior and fitness

Accurate And Real-Time Human Action Recognition Based On 3d Skeleton

An Approach to Pose-Based Action Recognition

Multimodal Fusion via Teacher-Student Network for Indoor Action Recognition

Student Motivation Analysis Based on Raising-Hand Videos

An Interactive Teaching System for Ethnic Minority Dance Based on Deep Learning

Skeleton-Based Mutually Assisted Interacted Object Localization and Human Action Recognition

Student behavior recognition for interaction detection in the classroom environment

RARN: A Real-Time Skeleton-based Action Recognition Network for Auxiliary Rehabilitation Therapy