Abstract:Deep learning technology has recently become increasingly prevalent in the field of education due to the rapid growth of artificial intelligence. Teachers' teaching behavior is a crucial component of classroom teaching activities, and identifying and examining teachers' classroom teaching behavior is an important way to assess teaching. However, the traditional teaching evaluation method involves evaluating by either listening to the class on-site or playing back the teaching video afterward, which is a time-consuming and inefficient manual method. Therefore, this paper obtained teaching behavior data from a real smart classroom scenario and observed and analyzed the teacher behavior characteristics in this scenario. Aiming at the problems of complex classroom environments and the high similarity between teaching behavior classes, a method to improve YOLOv7 for large target classroom behavior recognition in smart classroom scenarios is proposed. First, we constructed the Teacher Classroom Behavior Data Set (TCBDS), which contains 6660 images covering six types of teaching behaviors: facing the board (to_blackboard, tb), facing the students (to_student, ts), writing on the board (writing, w), teaching while facing the board (black_teach, bt), teaching while facing the students (student_teach, st), and interactive (interact, i). This research adds a large target detection layer to the backbone network so that teachers' instructional behaviors can be efficiently identified in complex classroom circumstances. Second, the original model's backbone was extended with an effective multiscale attention module (EMA) to construct cross-scale feature dependencies under various branches. Finally, the bounding box loss function of the original model was replaced with MPDIoU, and a bounding box scaling factor was introduced to propose the Inner_MPDIoU loss function. Experiments were conducted using the TCBDS dataset. The method proposed in this study achieved mAP@.50, mAP@.50:.95, and recall values of 96.2%, 82.5%, and 92.9%, respectively—improvements of 1.1%, 2.0%, and 2.3% over the original model. This method outperformed other mainstream models compared to the current state of the art. The experimental results demonstrate the method's excellent performance, its ability to identify various classroom behaviors of teachers in realistic scenarios, and its potential to facilitate the analysis and visualization of teacher classroom behaviors.

Research on Intelligent Recognition Algorithm of College Students’ Classroom Behavior Based on Improved Single Shot Multibox Detector

System Analysis of the Learning Behavior Recognition System for Students in a Law Classroom: Based on the Improved SSD Behavior Recognition Algorithm

A Study of Classroom Behavior Recognition Incorporating Super-Resolution and Target Detection

Intelligent Student Behavior Analysis System for Real Classrooms

Classroom Behavior Recognition Based on Improved Yolov3

Post-secondary classroom teaching quality evaluation using small object detection model

Teacher–Student Behavior Recognition in Classroom Teaching Based on Improved YOLO-v4 and Internet of Things Technology

Optimization of College English Classroom Teaching Efficiency by Deep Learning SDD Algorithm

Intelligent Education Managemnt System Design for Universities based on MTCNN Face Recognition Algorithm

Multi-Object Detection Based On Deep Learning In Real Classrooms

Multi-object behaviour recognition based on object detection cascaded image classification in classroom scenes

Student Behavior Recognition From Heterogeneous View Perception in Class Based on 3-D Multiscale Residual Dense Network for the Analysis of Case Teaching

Student Behavior Detection in the Classroom Based on Improved YOLOv8

Improving YOLOv7 for Large Target Classroom Behavior Recognition of Teachers in Smart Classroom Scenarios

A Classroom Students Convergent Behavior Analysis System Based on Image Recognition

Student behavior recognition based on multitask learning

Multi-Scale Deformable Transformers for Student Learning Behavior Detection in Smart Classroom

Learning Behavior Recognition in Smart Classroom with Multiple Students Based on YOLOv5

Classroom Behavior Detection Based on Improved YOLOv5 Algorithm Combining Multi-Scale Feature Fusion and Attention Mechanism

Multimodal behavior analysis in computer-enabled laboratories using nonverbal cues

Behavior Recognition of College Students Based on Improved Deep Learning Algorithm