Abstract:technology is increasingly used in applications such as 3-D displays and human-computer interaction (HCI). However, most current eye trackers focus on 2-D point-of-gaze (PoG) estimation and cannot provide accurate gaze depth. Concerning future applications such as HCI with 3-D displays, we propose an integrated binocular eye-tracking device with stereo stimuli to provide highly accurate 3-D PoG estimation. In our device, the 3-D stereo imaging system can provide users with a friendly and immersive 3-D visual experience without wearing any accessories. The eye-capturing system can directly record the users' eye movements under 3-D stimuli without disturbance, which can realize front views of eye images while ensuring the user's wide field of view (FOV). A regression based 3-D eye-tracking model is built based on collected eye movement data under stereo stimuli. Our model estimates users' 2-D gaze with features defined by eye region landmarks and further estimates 3-D gaze with a multisource feature set constructed by comprehensive eye movement features and disparity features from stereo stimuli. Two test stereo scenes with different depths of field are designed to verify the model's effectiveness. Experimental results of fourfold cross-validation show that the average error for 2-D gaze estimation was 0.65(?). For 3-D gaze estimation, the average errors are 1.69 cm over the workspace volume 50 x 30 x 75 cm(3) and 0.14 m over the workspace volume 2.4 x 4.0 x 7.9 m(3). Two preliminary validation experiments also demonstrate that our system has broad application prospects, such as 3-D vision technologies and medical applications related to neurological diseases.

Manipulation of video eye gaze and head orientation for video teleconferencing

Gaze awareness for video-conferencing: A software approach

Eye gaze correction with stereovision for video-teleconferencing

Eye-gaze Tracking under Unrestrained Head Movements

Gaze Correction for 3D Tele-Immersive Communication System

LookAtChat: Visualizing Gaze Awareness for Remote Small-Group Conversations

Indicating eye contacts in one-to-many video teleconference with one web camera

The Real-Time Eye-Controlled System Based on the Near-Field Video Streams

Eye-Gaze Tracking Research Based on Image Processing

Study on User-Generated 3D Gestures for Video Conferencing System with See-Through Head Mounted Display

Designing Gaze-Based Interactions for Teleoperation: Eye Stick and Eye Click

Sparsity-based Joint Gaze Correction and Face Beautification for Conferencing Video

GazeDirector: Fully Articulated Eye Gaze Redirection in Video

Instant interaction driven adaptive gaze control interface

Auto-Stereoscopic 3D Video Conversation System Based on an Improved Eye Tracking Method

Human Perception-Enhanced Camera System for Web Conferences Leveraging Device Motions

Restoring Eye Contact to the Virtual Classroom with Machine Learning

Perceiving and rendering users in a 3D interaction

Eye gaze tracking based directional control interface for interactive applications

Depth from motion parallax: Deictic consistency, eye contact, and a serious problem with Zoom

A Novel Integrated Eye-Tracking System with Stereo Stimuli for 3-D Gaze Estimation