Abstract:Virtual reality (VR) is a rapidly developing technology that simulates the real world. However, for some cybersickness-susceptible people, VR still has an unanswered problem-cybersickness-which becomes the main obstacle for users and content makers. Sensory conflict theory is a widely accepted theory for cybersickness. It proposes that conflict between afferent signals and internal models can cause cybersickness. This study analyzes the brain states that determine cybersickness occurrence and related uncomfortable feelings. Furthermore, we use the electroencephalogram (EEG) microstates and functional connectivity approach based on the sensory conflict theory. The microstate approach is a time-space analysis method that allows signals to be divided into several temporarily stable states, simultaneously allowing for the exploration of short- and long-range signals. These temporal dynamics can show the disturbances in mental processes associated with neurological and psychiatric conditions of cybersickness. Furthermore, the functional connectivity approach gives us in-depth insight and relationships between the sources related to cybersickness. We recruited 40 males (24.1 ± 2.3 years), and they watched a VR video on a curved computer monitor for 10 min to experience cybersickness. We recorded the 5-min resting state EEG (baseline condition) and 10-min EEG while watching the VR video (task condition). Then, we performed a microstate analysis, focusing on two temporal parameters: mean duration and global explained variance (GEV). Finally, we obtained the functional connectivity data using eLoreta and lagged phase synchronization (LPS). We discovered five sets of microstates (A-E), including four widely reported canonical microstates (A-D), during baseline and task conditions. The average duration increased in microstates A and B, which is related to the visual and auditory networks. The GEV and duration decreased in microstate C, whereas those in microstate D increased. Microstate C is related to the default mode network (DMN) and D to the attention network. The temporal dynamics of the microstate parameters are from cybersickness disturbing the sensory, DMN, and attention networks. In the functional connectivity part, the LPS between the left and right parietal operculum (OP) significantly decreased (p < 0.05) compared with the baseline condition. Furthermore, the connectivity between the right OP and V5 significantly decreased (p < 0.05). These results also support the disturbance of the sensory network because a conflict between the visual (V5) and vestibular system (OP) causes cybersickness. Changes in the microstates and functional connectivity support the sensory conflict theory. These results may provide additional information in understanding brain dynamics during cybersickness.

Exploring Quantitative Assessment of Cybersickness in Virtual Reality Using EEG Signals and a CNN-LSTM Network

Prediction and detection of virtual reality induced cybersickness: a spiking neural network approach using spatiotemporal EEG brain data and heart rate variability

Automatic Prediction of Cybersickness for Virtual Reality Games

A Review of Deep Learning Approaches to EEG-Based Classification of Cybersickness in Virtual Reality

Cybersickness Detection through Head Movement Patterns: A Promising Approach

Multimodal Biosensing for Vestibular Network-Based Cybersickness Detection

VR Sickness Prediction from Integrated HMD's Sensors using Multimodal Deep Fusion Network

Feature extraction method of EEG based on wavelet packet reconstruction and deep learning model of VR motion sickness feature classification and prediction

Classification of Visually Induced Motion Sickness Based on Phase-Locked Value Functional Connectivity Matrix and CNN-LSTM

Prediction of cybersickness in virtual environments using topological data analysis and machine learning

Detection of virtual reality motion sickness based on EEG using asymmetry of entropy and cross-frequency coupling

Identifying presence of cybersickness symptoms using AI-based predictive learning algorithms

Assessing Individual VR Sickness through Deep Feature Fusion of VR Video and Physiological Response

Predicting Cybersickness Using Machine Learning and Demographic Data in Virtual Reality

A Deep Cybersickness Predictor through Kinematic Data with Encoded Physiological Representation

Electroencephalogram microstates and functional connectivity of cybersickness

EEG-Based 3D Visual Fatigue Evaluation Using CNN

Multi-level Stress Assessment from ECG in a Virtual Reality Environment using Multimodal Fusion

Spatial-Frequency Characteristics of EEG Associated With the Mental Stress in Human-Machine Systems

Examination of Cybersickness in Virtual Reality: The Role of Individual Differences, Effects on Cognitive Functions & Motor Skills, and Intensity Differences During and After Immersion

TruVR: Trustworthy Cybersickness Detection using Explainable Machine Learning