Abstract:Virtual reality (VR) enables the development of virtual training frameworks suitable for various domains, especially when real-world conditions may be hazardous or impossible to replicate because of unique additional resources (e.g., equipment, infrastructure, people, locations). Although VR technology has significantly advanced in recent years, methods for evaluating immersion (i.e., the extent to which the user is engaged with the sensory information from the virtual environment or is invested in the intended task) continue to rely on self-reported questionnaires, which are often administered after using the virtual scenario. Having an objective method to measure immersion is particularly important when using VR for training, education, and applications that promote the development, fine-tuning, or maintenance of skills. The level of immersion may impact performance and the translation of knowledge and skills to the real-world. This is particularly important in tasks where motor skills are combined with complex decision making, such as surgical procedures. Efforts to better measure immersion have included the use of physiological measurements including heart rate and skin response, but so far they do not offer robust metrics that provide the sensitivity to discriminate different states (idle, easy, and hard), which is critical when using VR for training to determine how successful the training is in engaging the user's senses and challenging their cognitive capabilities. In this study, electroencephalography (EEG) data were collected from 14 participants who completed VR jigsaw puzzles with two different levels of task difficulty. Machine learning was able to accurately classify the EEG data collected during three different states, obtaining accuracy rates of 86% and 97% for differentiating easy versus hard difficulty states and baseline vs. VR states. Building on these results may enable the identification of robust biomarkers of immersion in VR, enabling real-time recognition of the level of immersion that can be used to design more effective and translative VR-based training. This method has the potential to adjust aspects of VR related to task difficulty to ensure that participants are immersed in VR.

EEG-Based VR Video Quality Measurement for Resolution Reduction

Video Quality Measurement for Buffering Time Based on EEG Frequency Feature

A QoE Physiological Measure of VR with Vibrotactile Feedback based on Frontal Lobe Power Asymmetry

A low-cost, wireless, 4-channel EEG measurement system used in virtual reality environments

Research on the Creative Performance of Digital Film and Television Works Based on Virtual Reality Technology

Modeling the Impact of Spatial Resolutions on Perceptual Quality of Immersive Image/video.

A High-Density EEG Study Investigating VR Film Editing and Cognitive Event Segmentation Theory

Modeling Gamer Quality-of-Experience Using a Real Cloud VR Gaming Testbed.

Brain-Inspired Image Perceptual Quality Assessment Based on EEG: A QoE Perspective

Research on the Perceived Quality of Virtual Reality Headsets in Human-Computer Interaction

EEG-Based Evaluation of Aesthetic Experience Using BiLSTM Network

Exploring Quantitative Assessment of Cybersickness in Virtual Reality Using EEG Signals and a CNN-LSTM Network

A Novel Method to Understand Neural Oscillations During Full-Body Reaching: A Combined EEG and 3D Virtual Reality Study

Biomarkers of Immersion in Virtual Reality Based on Features Extracted from the EEG Signals: A Machine Learning Approach

Classification of EEG evoked in 2D and 3D virtual reality: traditional machine learning versus deep learning

Cviqd: Subjective Quality Evaluation Of Compressed Virtual Reality Images

Assessing the Impact of Network Quality-of-Service on Metaverse Virtual Reality User Experience

Adaptive Cloud VR Gaming Optimized by Gamer QoE Models

Perceptual Quality Assessment of Virtual Reality Videos in the Wild

Visual Attention Measurement Based on Electroencephalogram Feature Learning

Relaxation Degree Analysis Using Frontal Electroencephalogram Under Virtual Reality Relaxation Scenes