Abstract:Human action recognition has attracted considerable research attention in the field of computer vision, especially for classroom environments. However, most relevant studies have focused on one specific behavior of students. Therefore, this paper proposes a student behavior recognition system based on skeleton pose estimation and person detection. First, consecutive frames captured with a classroom camera were used as the input images of the proposed system. Then, skeleton data were collected using the OpenPose framework. An error correction scheme was proposed based on the pose estimation and person detection techniques to decrease incorrect connections in the skeleton data. The preprocessed skeleton data were subsequently used to eliminate several joints that had a weak effect on behavior classification. Second, feature extraction was performed to generate feature vectors that represent human postures. The adopted features included normalized joint locations, joint distances, and bone angles. Finally, behavior classification was conducted to recognize student behaviors. A deep neural network was constructed to classify actions, and the proposed system was able to identify the number of students in a classroom. Moreover, a system prototype was implemented to verify the feasibility of the proposed system. The experimental results indicated that the proposed scheme outperformed the skeleton-based scheme in complex situations. The proposed system had a 15.15% higher average precision and 12.15% higher average recall than the skeleton-based scheme did.

Behavior Classification Method Based on Skeleton Model from Video Images

Human Pose Tracking Algorithm Based on Skeleton-Texture Model

Real-time human behavior recognition based on articulated model

Hybrid Silhouette-skeleton Body Representation for Gait Recognition

Human skeleton behavior recognition model based on multi-object pose estimation with spatiotemporal semantics

Behavior Recognition Algorithm Based on Key Points of Human Bones

Video Abnormal Behavior Recognition and Trajectory Prediction Based on Lightweight Skeleton Feature Extraction

Dynamic Human Behavior Pattern Detection and Classification

Human Action Recognition Based on Human Skeleton Hu Invariant Moments Combined with Human Geometrical Characteristics

Background separation of sports athletes and motion image analysis based on skeleton segmentation algorithm

Online Robust Action Recognition Based on a Hierarchical Model

Student Behavior Recognition System for the Classroom Environment Based on Skeleton Pose Estimation and Person Detection

Robust Activity Recognition Based on Human Skeleton for Video Surveillance

Human Kinematics-inspired Skeleton-based Video Anomaly Detection

Human Motion Recognition in Video

Real-Time Human Skeleton Extraction Based on Video Sequences

Gait Identification under Surveillance Environment based on Human Skeleton

Human motion recognition using three-dimensional skeleton model based on RGBD vision system

Skeleton Based Abnormal Behavior Recognition Using Spatio-Temporal Convolution and Attention-Based LSTM

3D Human behavior recognition based on binocular vision and face–hand feature

A Skeleton-based Approach for Campus Violence Detection