Abstract:Based on the classroom teaching scenarios, an improved YOLO-v4 behavior detection algorithm is proposed to recognize the behaviors of teachers and students. With the development of CNN (Convolutional Neural Networks) and IoT (Internet of Things) technologies, target detection algorithms based on deep learning have become mainstream, and typical algorithms such as SSD (Single Shot Detection) and YOLO series have emerged. Based on the videos or images collected in the perception layer of the IoT paradigm, deep learning models are used in the processing layer to implement various intelligent applications. However, none of these deep learning-based algorithms are perfect, and there is room for improvement in terms of detection accuracy, computing speed, and multi-target detection capabilities. In this paper, by introducing the concept of cross-stage local network, embedded connection (EC) components are constructed and embedded at the end of the YOLO-v4 network to obtain an improved YOLO-v4 network. Aiming at the problem that it is difficult to quickly and effectively identify the students' actions when they are occluded, the Repulsion loss function is connected in series on the basis of the original YOLO-v4 loss function. The newly added loss function consists of two parts: RepGT loss and RepBox loss. The RepGT loss function is used to calculate the loss values between the target prediction box and the adjacent ground truth boxes to reduce false positive detection results; the RepBox loss function is used to calculate the loss value between the target prediction box and other adjacent target prediction boxes to reduce false negative detection results. The training and testing are carried out on the classroom behavior datasets of teachers and students, respectively. The experimental results show that the average precision of identifying various classroom behaviors of different targets exceeds 90%, which verifies the effectiveness of the proposed method. The model performs well in sustainable classroom behavior recognition in educational context, accurate recognition of classroom behaviors can help teachers and students better understand classroom learning and promote the development of intelligent classroom model.

Human Behaviour Recognition Using Deep Learning

Deep Learning Methods for Human Behavior Recognition.

Human behaviour recognition and monitoring based on deep convolutional neural networks

DeepBhvTracking: A Novel Behavior Tracking Method for Laboratory Animals Based on Deep Learning

Human Action Recognition Using Deep Learning Methods.

Overview of behavior recognition based on deep learning

Human Action Recognition From Digital Videos Based on Deep Learning.

Human Behavior Recognition from Multiview Videos

Face Detection and Recognition from Distance Based on Deep Learning

Research Progress on the Human Behavior Recognition Based on Machine Learning Methods

A Systematic Survey on Human Behavior Recognition Methods

Body and Hand–Object ROI-Based Behavior Recognition Using Deep Learning

Human Activities Detection using DeepLearning Technique- YOLOv8

A Study of Classroom Behavior Recognition Incorporating Super-Resolution and Target Detection

A Close Look into Human Activity Recognition Models using Deep Learning

Human Behavior Recognition Based on Multiscale Convolutional Neural Network.

Research on Human Abnormal Behavior Detection Based on Deep Learning

Teacher–Student Behavior Recognition in Classroom Teaching Based on Improved YOLO-v4 and Internet of Things Technology

Deep Learning-Based Human Action Recognition in Videos

Learning Behavior Recognition in Smart Classroom with Multiple Students Based on YOLOv5