Abstract:Speed and consistency of target-shifting play a crucial role in human ability to perform complex tasks. Shifting our gaze between objects of interest quickly and consistently requires changes both in depth and direction. Gaze changes in depth are driven by slow, inconsistent vergence movements which rotate the eyes in opposite directions, while changes in direction are driven by ballistic, consistent movements called saccades, which rotate the eyes in the same direction. In the natural world, most of our eye movements are a combination of both types. While scientific consensus on the nature of saccades exists, vergence and combined movements remain less understood and agreed upon. We eschew the lack of scientific consensus in favor of proposing an operationalized computational model which predicts the speed of any type of gaze movement during target-shifting in 3D. To this end, we conduct a psychophysical study in a stereo VR environment to collect more than 12,000 gaze movement trials, analyze the temporal distribution of the observed gaze movements, and fit a probabilistic model to the data. We perform a series of objective measurements and user studies to validate the model. The results demonstrate its predictive accuracy, generalization, as well as applications for optimizing visual performance by altering content placement. Lastly, we leverage the model to measure differences in human target-changing time relative to the natural world, as well as suggest scene-aware projection depth. By incorporating the complexities and randomness of human oculomotor control, we hope this research will support new behavior-aware metrics for VR/AR display design, interface layout, and gaze-contingent rendering.

Eye Gaze-based Object Rotation for Head-mounted Displays.

Advancing Virtual Reality Interaction: A Ring-Shaped Controller and Pose Tracking

Human Gaze and Head Rotation during Navigation, Exploration and Object Manipulation in Shared Environments with Robots

Designing Gaze-Based Interactions for Teleoperation: Eye Stick and Eye Click

General In-Hand Object Rotation with Vision and Touch

DEEP: 3D Gaze Pointing in Virtual Reality Leveraging Eyelid Movement

Towards Robust Robot Control in Cartesian Space Using an Infrastructureless Head- and Eye-Gaze Interface

Multimodal Gaze Stabilization of a Humanoid Robot based on Reafferences

Gaze Modulated Disambiguation Technique for Gesture Control in 3D Virtual Objects Selection

Rotating Objects via In-Hand Pivoting using Vision, Force and Touch

GazeDirector: Fully Articulated Eye Gaze Redirection in Video

The Shortest Route Is Not Always the Fastest: Probability-Modeled Stereoscopic Eye Movement Completion Time in VR

Eye Gaze Based 3D Triangulation for Robotic Bionic Eyes

Optimization-Based Eye Tracking using Deflectometric Information

Design Principles and Challenges for Gaze + Pinch Interaction in XR

3D Face Reconstruction and Gaze Tracking in the HMD for Virtual Interaction `

Eyes-Free Target Acquisition in Interaction Space Around the Body for Virtual Reality.

Persistent Human–Machine Interfaces for Robotic Arm Control Via Gaze and Eye Direction Tracking

Attention computing for enhanced visuomotor skill performance: Testing the effectiveness of gaze-adaptive cues in virtual reality golf putting

Experimental Analysis of Freehand Multi-Object Selection Techniques in Virtual Reality Head-Mounted Displays

FocusFlow: 3D Gaze-Depth Interaction in Virtual Reality Leveraging Active Visual Depth Manipulation