Abstract:For evaluating whether an eye-tracker is suitable for measuring microsaccades, Poletti & Rucci (2016) propose that a measure called 'resolution' could be better than the more established root-mean-square of the sample-to-sample distances (RMS-S2S). Many open questions exist around the resolution measure, however. Resolution needs to be calculated using data from an artificial eye that can be turned in very small steps. Furthermore, resolution has an unclear and uninvestigated relationship to the RMS-S2S and STD (standard deviation) measures of precision (Holmqvist & Andersson, 2017, p. 159-190), and there is another metric by the same name (Clarke, Ditterich, Drüen, Schönfeld, and Steineke 2002), which instead quantifies the errors of amplitude measurements. In this paper, we present a mechanism, the Stepperbox, for rotating artificial eyes in arbitrary angles from 1' (arcmin) and upward. We then use the Stepperbox to find the minimum reliably detectable rotations in 11 video-based eye-trackers (VOGs) and the Dual Purkinje Imaging (DPI) tracker. We find that resolution correlates significantly with RMS-S2S and, to a lesser extent, with STD. In addition, we find that although most eye-trackers can detect some small rotations of an artificial eye, the rotations of amplitudes up to 2∘ are frequently erroneously measured by video-based eye-trackers. We show evidence that the corneal reflection (CR) feature of these eye-trackers is a major cause of erroneous measurements of small rotations of artificial eyes. Our data strengthen the existing body of evidence that video-based eye-trackers produce errors that may require that we reconsider some results from research on reading, microsaccades, and vergence, where the amplitude of small eye movements have been measured with past or current video-based eye-trackers. In contrast, the DPI reports correct rotation amplitudes down to 1'.

Threats to the validity of eye-movement research in psychology

Eye tracking in developmental cognitive neuroscience – The good, the bad and the ugly

An examination of the effects of eye-tracking on behavior in psychology experiments

Investigating the suitability of online eye tracking for psychological research: Evidence from comparisons with in-person data using emotion-attention interaction tasks

Eye Tracking Methodology for Research in Consumer Psychology

The impact of slippage on the data quality of head-worn eye trackers

Eye Movement Research in the Twenty-First Century—a Window to the Brain, Mind, and More

Eye Tracking to Assess the Functional Consequences of Vision Impairment: A Systematic Review

Understanding cognitive and affective mechanisms in social psychology through eye-tracking

A short review and primer on eye tracking in human computer interaction applications

Implications of eye tracking technology for applied sport psychology

Deep learning models for webcam eye tracking in online experiments

Reliably Measuring Learning-Dependent Distractor Suppression with Eye Tracking

Application of Eye Tracking Technology in Aviation, Maritime, and Construction Industries: A Systematic Review

Minimal reporting guideline for research involving eye tracking (2023 edition)

Small eye movements cannot be reliably measured by video-based P-CR eye-trackers

Eye Tracking and Eye-Based Human–Computer Interaction

A systematic review and research challenges on phishing cyberattacks from an electroencephalography and gaze-based perspective

Implementing mobile eye tracking in psychological research: A practical guide

Is the eye-movement field confused about fixations and saccades? A survey among 124 researchers

A Review of Main Eye Movement Tracking Methods