Abstract:Purpose Attention is one of the most important factors to affect the academic performance of students. Effectively analyzing students' attention in class can promote teachers' precise teaching and students' personalized learning. To intelligently analyze the students' attention in classroom from the first-person perspective, this paper proposes a fusion model based on gaze tracking and object detection. In particular, the proposed attention analysis model does not depend on any smart equipment. Design/methodology/approach Given a first-person view video of students' learning, the authors first estimate the gazing point by using the deep space–time neural network. Second, single shot multi-box detector and fast segmentation convolutional neural network are comparatively adopted to accurately detect the objects in the video. Third, they predict the gazing objects by combining the results of gazing point estimation and object detection. Finally, the personalized attention of students is analyzed based on the predicted gazing objects and the measurable eye movement criteria. Findings A large number of experiments are carried out on a public database and a new dataset that is built in a real classroom. The experimental results show that the proposed model not only can accurately track the students' gazing trajectory and effectively analyze the fluctuation of attention of the individual student and all students but also provide a valuable reference to evaluate the process of learning of students. Originality/value The contributions of this paper can be summarized as follows. The analysis of students' attention plays an important role in improving teaching quality and student achievement. However, there is little research on how to automatically and intelligently analyze students' attention. To alleviate this problem, this paper focuses on analyzing students' attention by gaze tracking and object detection in classroom teaching, which is significant for practical application in the field of education. The authors proposed an effectively intelligent fusion model based on the deep neural network, which mainly includes the gazing point module and the object detection module, to analyze students' attention in classroom teaching instead of relying on any smart wearable device. They introduce the attention mechanism into the gazing point module to improve the performance of gazing point detection and perform some comparison experiments on the public dataset to prove that the gazing point module can achieve better performance. They associate the eye movement criteria with visual gaze to get quantifiable objective data for students' attention analysis, which can provide a valuable basis to evaluate the learning process of students, provide useful learning information of students for both parents and teachers and support the development of individualized teaching. They built a new database that contains the first-person view videos of 11 subjects in a real classroom and employ it to evaluate the effectiveness and feasibility of the proposed model.

Research on the impact of pointing gestures based on computer vision technology on classroom concentration

An Eye Tracking Study: Positive Emotional Interface Design Facilitates Learning Outcomes in Multimedia Learning?

Analyzing students' attention by gaze tracking and object detection in classroom teaching

How attentive is a student in class? A concentration evaluation method based on head Euler angle

Analysis on the innovative education mode of the integration of information technology and traditional teaching in the era of big data

Research on the Influence of AI and VR Technology for Students' Concentration and Creativity

An Approach of Query Audience's Attention in Virtual Speech

Evaluation of Online Teaching Quality Based on Facial Expression Recognition

Influential factors for medical students' classroom concentration—evaluation with speech recognition and face recognition technology

An English video teaching classroom attention evaluation model incorporating multimodal information

Learning attention characterization based on head pose sight estimation

Application of Facial Analysis Based on Convolutional Neural Network and Iterative Decision Tree for Teaching Evaluation in Smart Classrrom

Educational Psychology Analysis Method for Extracting Students' Facial Information Based on Image Big Data

Student offline classroom concentration identification research based on deep learning

The Research of Online Classroom Status Feedback Based on Facial Expression Recognition Technology

Video-based Student Classroom Classroom Behavior State Analysis

Modeling Students' Attention in the Classroom using Eyetrackers

Calculation of the Rate of Taking Lessons Based on Face Recognition and Head Pose Estimation

A Deep-Learning Based Method for Analysis of Students’ Attention in Offline Class

Simulation of English classroom effectiveness based on human-computer interaction and facial identification

Teacher's Perception in the Classroom