Abstract:Virtual reality (VR) is not a new technology but has been in development for decades, driven by advances in computer technology. Currently, VR technology is increasingly being used in applications to enable immersive, yet controlled research settings. Education and entertainment are two important application areas, where VR has been considered a key enabler of immersive experiences and their further advancement. At the same time, the study of human behavior in such innovative environments is expected to contribute to a better design of VR applications. Therefore, modern VR devices are consistently equipped with eye-tracking technology, enabling thus further studies of human behavior through the collection of process data. In particular, eye-tracking technology in combination with machine learning techniques and explainable models can provide new insights for a deeper understanding of human behavior during immersion in virtual environments. In this work, a systematic computational framework based on eye-tracking and behavioral user data and state-of-the-art machine learning approaches is proposed to understand human behavior and individual differences in VR contexts. This computational framework is then employed in three user studies across two different domains. In the educational domain, two different immersive VR classrooms were created where students can learn and teachers can train. In terms of VR entertainment, eye movements open a new avenue to evaluate VR locomotion techniques from the perspective of user cognitive load and user experience. This work paves the way for assessing human behavior in VR scenarios and provides profound insights into the way of designing, evaluating, and improving interactive VR systems. In particular, more effective and customizable virtual environments can be created to provide users with tailored experiences.

Eye Tracking in Virtual Reality: a Broad Review of Applications and Challenges

Eye-tracking on virtual reality: a survey

Eye-Tracking in Immersive Virtual Reality for Education: A Review of the Current Progress and Applications

Eye-tracked Virtual Reality: A Comprehensive Survey on Methods and Privacy Challenges

Trends in Virtual and Augmented Reality Research: A Review of Latest Eye Tracking Research Papers and Beyond

The Eye in Extended Reality: A Survey on Gaze Interaction and Eye Tracking in Head-worn Extended Reality

Application of eye-tracking systems integrated into immersive virtual reality and possible transfer to the sports sector - A systematic review

Towards Everyday Virtual Reality through Eye Tracking

Eye Tracking to Assess the Functional Consequences of Vision Impairment: A Systematic Review

Assessment of Human Behavior in Virtual Reality by Eye Tracking

Overview of the Use of Eye-Tracking Technology for Monitoring Consumer Views

Combining EEG and Eye-Tracking in Virtual Reality - Obtaining Fixation-Onset ERPs and ERSPs

Implicit gaze research for XR systems

Eye tracking technology in medical practice: a perspective on its diverse applications

Usage and Effect of Eye Tracking in Remote Guidance

Eye Movement and Pupil Measures: A Review

Eye tracking in library and information science: a literature review

Head-mounted eye gaze tracking devices: An overview of modern devices and recent advances

Evaluation of Eye Tracking Signal Quality for Virtual Reality Applications: A Case Study in the Meta Quest Pro

An investigation of feed-forward and feedback eye movement training in immersive virtual reality

A Survey on Eye-Gaze Tracking Techniques