Abstract:Purpose Attention is one of the most important factors to affect the academic performance of students. Effectively analyzing students' attention in class can promote teachers' precise teaching and students' personalized learning. To intelligently analyze the students' attention in classroom from the first-person perspective, this paper proposes a fusion model based on gaze tracking and object detection. In particular, the proposed attention analysis model does not depend on any smart equipment. Design/methodology/approach Given a first-person view video of students' learning, the authors first estimate the gazing point by using the deep space–time neural network. Second, single shot multi-box detector and fast segmentation convolutional neural network are comparatively adopted to accurately detect the objects in the video. Third, they predict the gazing objects by combining the results of gazing point estimation and object detection. Finally, the personalized attention of students is analyzed based on the predicted gazing objects and the measurable eye movement criteria. Findings A large number of experiments are carried out on a public database and a new dataset that is built in a real classroom. The experimental results show that the proposed model not only can accurately track the students' gazing trajectory and effectively analyze the fluctuation of attention of the individual student and all students but also provide a valuable reference to evaluate the process of learning of students. Originality/value The contributions of this paper can be summarized as follows. The analysis of students' attention plays an important role in improving teaching quality and student achievement. However, there is little research on how to automatically and intelligently analyze students' attention. To alleviate this problem, this paper focuses on analyzing students' attention by gaze tracking and object detection in classroom teaching, which is significant for practical application in the field of education. The authors proposed an effectively intelligent fusion model based on the deep neural network, which mainly includes the gazing point module and the object detection module, to analyze students' attention in classroom teaching instead of relying on any smart wearable device. They introduce the attention mechanism into the gazing point module to improve the performance of gazing point detection and perform some comparison experiments on the public dataset to prove that the gazing point module can achieve better performance. They associate the eye movement criteria with visual gaze to get quantifiable objective data for students' attention analysis, which can provide a valuable basis to evaluate the learning process of students, provide useful learning information of students for both parents and teachers and support the development of individualized teaching. They built a new database that contains the first-person view videos of 11 subjects in a real classroom and employ it to evaluate the effectiveness and feasibility of the proposed model.

Modeling Students' Attention in the Classroom using Eyetrackers

Analyzing students' attention by gaze tracking and object detection in classroom teaching

Assessment of Student Attentiveness to E-Learning by Monitoring Behavioural Elements

Real-time estimation of overt attention from dynamic features of the face using deep-learning

Student Engagement Detection Using Emotion Analysis, Eye Tracking and Head Movement with Machine Learning

Teacher's Perception in the Classroom

Artificial Intelligence-based System for Detecting Attention Levels in Students

An Online Education Effect Assessing Method Based on YOLOv8 and Vision Transformer

A Deep-Learning Based Method for Analysis of Students’ Attention in Offline Class

Learner Attentiveness and Engagement Analysis in Online Education Using Computer Vision

Modeling Programmer Attention as Scanpath Prediction

Multimodal human attention detection for reading from facial expression, eye gaze, and mouse dynamics

Biometrics and Behavior Analysis for Detecting Distractions in e-Learning

Deep neural networks for collaborative learning analytics: Evaluating team collaborations using student gaze point prediction

Did You Get That? Predicting Learners' Comprehension of a Video Lecture from Visualizations of Their Gaze Data

An Interpretable and Attention-based Method for Gaze Estimation Using Electroencephalography

AttentioNet: Monitoring Student Attention Type in Learning with EEG-Based Measurement System

How Facial Features Convey Attention in Stationary Environments

How attentive is a student in class? A concentration evaluation method based on head Euler angle

Eye tracking method based on mobile big data in computer environment

Assessing the Effects of Various Physiological Signal Modalities on Predicting Different Human Cognitive States