Abstract:Virtual reality (VR) enables the development of virtual training frameworks suitable for various domains, especially when real-world conditions may be hazardous or impossible to replicate because of unique additional resources (e.g., equipment, infrastructure, people, locations). Although VR technology has significantly advanced in recent years, methods for evaluating immersion (i.e., the extent to which the user is engaged with the sensory information from the virtual environment or is invested in the intended task) continue to rely on self-reported questionnaires, which are often administered after using the virtual scenario. Having an objective method to measure immersion is particularly important when using VR for training, education, and applications that promote the development, fine-tuning, or maintenance of skills. The level of immersion may impact performance and the translation of knowledge and skills to the real-world. This is particularly important in tasks where motor skills are combined with complex decision making, such as surgical procedures. Efforts to better measure immersion have included the use of physiological measurements including heart rate and skin response, but so far they do not offer robust metrics that provide the sensitivity to discriminate different states (idle, easy, and hard), which is critical when using VR for training to determine how successful the training is in engaging the user's senses and challenging their cognitive capabilities. In this study, electroencephalography (EEG) data were collected from 14 participants who completed VR jigsaw puzzles with two different levels of task difficulty. Machine learning was able to accurately classify the EEG data collected during three different states, obtaining accuracy rates of 86% and 97% for differentiating easy versus hard difficulty states and baseline vs. VR states. Building on these results may enable the identification of robust biomarkers of immersion in VR, enabling real-time recognition of the level of immersion that can be used to design more effective and translative VR-based training. This method has the potential to adjust aspects of VR related to task difficulty to ensure that participants are immersed in VR.

Measuring and defining the experience of immersion in games

The Why, What, and How of Immersive Experience

Measuring Player Immersion in the Computer Game Narrative.

Game immersion experience: its hierarchical structure and impact on game-based science learning

Comparing The Psychological And Physiological Measurement Of Player'S Engaging Experience In Computer Game

Attention, time perception and immersion in games

Affective Ludology, Flow and Immersion in a First- Person Shooter: Measurement of Player Experience

An experimental protocol to access immersiveness in video games

Study On Player Experience In The Game World

Immersion Metrics for Virtual Reality

Immersive experience framework: a Delphi approach

Defining Immersion: Literature Review and Implications for Research on Audiovisual Experiences

Immersive media experience: a survey of existing methods and tools for human influential factors assessment

QUALINET White Paper on Definitions of Immersive Media Experience (IMEx)

The Role of Attention in Immersion: The Two–Competitor Model

Evaluating the Impact of Highly Immersive Technologies and Natural Interaction on Player Engagement and Flow Experience in Games

Biomarkers of Immersion in Virtual Reality Based on Features Extracted from the EEG Signals: A Machine Learning Approach

Player Immersion In The Computer Game Narrative

Unveiling the key determinants and consequences of Virtual Reality in the immersion experience

Designing Experiences: A Virtual Reality Video Game to Enhance Immersion

Questionnaires and Qualitative Feedback Methods to Measure User Experience in Mixed Reality