Attention Mechanism based Real Time Gaze Tracking in Natural Scenes with Residual Blocks
Lihong Dai,Jinguo Liu,Zhaojie Ju,Yang Gao
DOI: https://doi.org/10.1109/tcds.2021.3064280
IF: 4.546
2021-01-01
IEEE Transactions on Cognitive and Developmental Systems
Abstract:Gaze tracking is widely used in fatigue driving detection, eye disease diagnosis, mental illness diagnosis, website or advertising design, virtual reality, gaze-control devices, and human–computer interaction. However, the influence of light, specular reflection, and occlusion, and the change of head pose, especially the ever-changing human pose in natural scenes, have brought great challenges to the accurate gaze tracking. In this article, gaze tracking in natural scenes is studied, and a method based on the convolutional neural network with residual blocks is proposed, in which the attention mechanism is integrated into the network to improve the accuracy of gaze tracking. Furthermore, it is tested on the GazeFollow database, which contains six kinds of databases. The results show that the performance of the proposed method outperforms that of the other state-of-the-art methods in natural scenes. Moreover, the proposed method has better real-time performance and is more suitable for practical applications.
robotics,computer science, artificial intelligence,neurosciences