Abstract:Eye movements offer valuable insights for clinical interventions, diagnostics, and understanding visual perception. The process usually involves recording a participant's eye movements and analyzing them in terms of various gaze events. Manual identification of these events is extremely time-consuming. Although the field has seen the development of automatic event detection and classification methods, these methods have primarily focused on distinguishing events when participants remain stationary. With increasing interest in studying gaze behavior in freely moving participants, such as during daily activities like walking, new methods are required to automatically classify events in data collected under unrestricted conditions. Existing methods often rely on additional information from depth cameras or inertial measurement units (IMUs), which are not typically integrated into mobile eye trackers. To address this challenge, we present a framework for classifying gaze events based solely on eye-movement signals and scene video footage. Our approach, the Automatic Classification of gaze Events in Dynamic and Natural Viewing (ACE-DNV), analyzes eye movements in terms of velocity and direction and leverages visual odometry to capture head and body motion. Additionally, ACE-DNV assesses changes in image content surrounding the point of gaze. We evaluate the performance of ACE-DNV using a publicly available dataset and showcased its ability to discriminate between gaze fixation, gaze pursuit, gaze following, and gaze shifting (saccade) events. ACE-DNV exhibited comparable performance to previous methods, while eliminating the necessity for additional devices such as IMUs and depth cameras. In summary, ACE-DNV simplifies the automatic classification of gaze events in natural and dynamic environments. The source code is accessible at https://github.com/arnejad/ACE-DNV.

Quantifying Gaze Behavior During Real-World Interactions Using Automated Object, Face, and Fixation Detection

A Single-Camera Gaze Tracking System under Natural Light

Detecting Gaze Towards Eyes in Natural Social Interactions and its Use in Child Assessment

Charting the Silent Signals of Social Gaze: Automating Eye Contact Assessment in Face-to-Face Conversations

A New Method to Evaluate Gaze Behavior Patterns in Doctor-Patient Interaction

Are you really looking at me? A Feature-Extraction Framework for Estimating Interpersonal Eye Gaze from Conventional Video

Instant interaction driven adaptive gaze control interface

Real-Time Multi-Map Saliency-Driven Gaze Behavior for Non-Conversational Characters

Gaze-in-wild: A dataset for studying eye and head coordination in everyday activities

Gaze Target Estimation inspired by Interactive Attention

Automatic Gaze Analysis: A Survey of Deep Learning based Approaches

Gaze Coordination of Groups in Dynamic Events - A Tool to Facilitate Analyses of Simultaneous Gazes Within a Team

Gaze estimation learning architecture as support to affective, social and cognitive studies in natural human-robot interaction

ACE-DNV: Automatic classification of gaze events in dynamic natural viewing

CasualGaze: Towards Modeling and Recognizing Casual Gaze Behavior for Efficient Gaze-based Object Selection

Low-cost Geometry-based Eye Gaze Detection using Facial Landmarks Generated through Deep Learning

Vision-based Gaze Estimation: A Review

Pose2Gaze: Eye-body Coordination during Daily Activities for Gaze Prediction from Full-body Poses

Social Visual Behavior Analytics for Autism Therapy of Children Based on Automated Mutual Gaze Detection

Gazing into the Abyss: Real-time Gaze Estimation

Real-Time Gaze Tracking with Event-Driven Eye Segmentation