Abstract:Eye tracking is playing an important role in many applications including human-computer interaction and behavior study. However, the existing approaches have at least one of the following limitations: (i) dedicated devices such as infrared camera and eye-tracker are required; (ii) complex calibration process is involved; (iii) substantial computing resources are consumed; (iv) users suffer from the risk of privacy leakage. To address the above limitations, we propose a H eatmap-based E ye T racking (HETrack) system. One of the key challenges in our system is to design a lightweight model for fine-grained tracking when the computing resources of device is limited. Also, it is necessary to protect user privacy in such a system. To address the above challenging issues, the proposed system consists of the following processes. First, when users randomly look at the screen of the device, HETrack obtains the raw image containing facial information. Then, we design a neural network model and train it with federated learning. The model can map the image to heatmap that implies the possibility of the user’s gaze position on the screen. Finally, HETrack can intercept the real-time video stream into frames, and employ the trained model to generate the heatmap of current frame for gaze estimation. We implement HETrack based on a Commercial-Off-The-Shelf (COTS) camera and conduct extensive experiments to evaluate its performance. Our HETrack system only requires once calibration; whereas, the state-of-the-art work proposed by Google requires 3~5 times calibration on average. Unlike previous approaches that transmit raw image data to a central server, in our HETrack system, only parameters are transmitted, thereby well protecting the user’s privacy. Experimental results demonstrate that the average distance error of estimated gaze point is 3cm, which is compatible with the state-of-the-art methods.

Interested Object Detection Based on Gaze Using Low-cost Remote Eye Tracker

A Single-Camera Gaze Tracking System under Natural Light

Gaze Tracking System Based on Pupil Detection

Eye-Gaze Tracking Research Based on Image Processing

Eye Tracking and ROI Detection Within a Computer Screen Using a Monocular Camera

Gaze Tracking Based Regions of Interest Detection Using A Web Camera

A low cost non-wearable gaze detection system based on infrared image processing

Research on eye gaze estimation based on low-cost eye movement recorder

Eye Gaze Tracking Based on the Shape of Pupil Image

Gaze-based Human Intention Prediction in the Hybrid Foraging Search Task

Region of Interest Detection Method Based on Gaze Tracking

A Survey on Gaze Estimation

Everyday Eye Contact Detection Using Unsupervised Gaze Target Discovery

VIS-iTrack: Visual Intention Through Gaze Tracking Using Low-Cost Webcam

A Lightweight Heatmap-based Eye Tracking System

Rapid Detection of Targets from Complex Backgrounds Based on Eye-tracking Data

An Approach of Region of Interest Detection Based on Visual Attention and Gaze Tracking

Design of Visual Gaze Target Locating Device Based on Depth Camera.

A Low Complexity Method For Real-Time Gaze Tracking

Low-cost Geometry-based Eye Gaze Detection using Facial Landmarks Generated through Deep Learning

Gaze Gestures and Their Applications in human-computer interaction with a head-mounted display