Abstract:Purpose Attention is one of the most important factors to affect the academic performance of students. Effectively analyzing students' attention in class can promote teachers' precise teaching and students' personalized learning. To intelligently analyze the students' attention in classroom from the first-person perspective, this paper proposes a fusion model based on gaze tracking and object detection. In particular, the proposed attention analysis model does not depend on any smart equipment. Design/methodology/approach Given a first-person view video of students' learning, the authors first estimate the gazing point by using the deep space–time neural network. Second, single shot multi-box detector and fast segmentation convolutional neural network are comparatively adopted to accurately detect the objects in the video. Third, they predict the gazing objects by combining the results of gazing point estimation and object detection. Finally, the personalized attention of students is analyzed based on the predicted gazing objects and the measurable eye movement criteria. Findings A large number of experiments are carried out on a public database and a new dataset that is built in a real classroom. The experimental results show that the proposed model not only can accurately track the students' gazing trajectory and effectively analyze the fluctuation of attention of the individual student and all students but also provide a valuable reference to evaluate the process of learning of students. Originality/value The contributions of this paper can be summarized as follows. The analysis of students' attention plays an important role in improving teaching quality and student achievement. However, there is little research on how to automatically and intelligently analyze students' attention. To alleviate this problem, this paper focuses on analyzing students' attention by gaze tracking and object detection in classroom teaching, which is significant for practical application in the field of education. The authors proposed an effectively intelligent fusion model based on the deep neural network, which mainly includes the gazing point module and the object detection module, to analyze students' attention in classroom teaching instead of relying on any smart wearable device. They introduce the attention mechanism into the gazing point module to improve the performance of gazing point detection and perform some comparison experiments on the public dataset to prove that the gazing point module can achieve better performance. They associate the eye movement criteria with visual gaze to get quantifiable objective data for students' attention analysis, which can provide a valuable basis to evaluate the learning process of students, provide useful learning information of students for both parents and teachers and support the development of individualized teaching. They built a new database that contains the first-person view videos of 11 subjects in a real classroom and employ it to evaluate the effectiveness and feasibility of the proposed model.

An Online Education Effect Assessing Method Based on YOLOv8 and Vision Transformer

An Attention Detection System Based on Gaze Estimation Using Self-supervised Learning

Engagement Detection in Online Learning Based on Pre-trained Vision Transformer and Temporal Convolutional Network

Learning State Assessment in Online Education Based on Multiple Facial Features Detection

Online Learning State Evaluation Method Based on Face Detection and Head Pose Estimation

A Deep-Learning Based Method for Analysis of Students’ Attention in Offline Class

Learner Attentiveness and Engagement Analysis in Online Education Using Computer Vision

Online Classroom Teaching Quality Evaluation System Based on Facial Feature Recognition

Online Classroom Evaluation System Based on Multi-Reaction Estimation

Evaluation of Online Teaching Quality Based on Facial Expression Recognition

Design of an Online Education Evaluation System Based on Multimodal Data of Learners.

Lightweight YOLOv8 Networks for Driver Profile Face Drowsiness Detection

Analyzing students' attention by gaze tracking and object detection in classroom teaching

Multimodal Learning Engagement Assessment System: An Innovative Approach to Optimizing Learning Engagement

An intelligent system for monitoring students' engagement in large classroom teaching through facial expression recognition

Learning Behavior Recognition in Smart Classroom with Multiple Students Based on YOLOv5

Data-driven Online Learning Engagement Detection via Facial Expression and Mouse Behavior Recognition Technology

Real-time estimation of overt attention from dynamic features of the face using deep-learning

Simulation of English classroom effectiveness based on human-computer interaction and facial identification

Data-driven learning fatigue detection system: A multimodal fusion approach of ECG (electrocardiogram) and video signals

Gaze Estimation Using Neural Network And Logistic Regression