The effect of mycophenolate mofetil on patients with active non-renal SLE.

K. Moder,Shreyasee Amin,M. Mazlumzadeh,C. Crowson,S. Ytterberg

2007-11-01

Clinical and Experimental Rheumatology

Abstract:

What problem does this paper attempt to address?

Identifying presence of cybersickness symptoms using AI-based predictive learning algorithms

DOI: https://doi.org/10.1007/s10055-023-00813-z

IF: 4.697

2023-05-31

Virtual Reality

Abstract:Cybersickness (CS) affects a large proportion of virtual reality (VR) users causing a combination of nausea, headaches and dizziness which would create barriers to the users, VR designers/developers and the stakeholders in the production industry. Although design principles suggest methods to avoid CS, challenges remain as new demands and systems continue to penetrate the competitive market. The dilemma is whether to use VR technology by experiencing the ultimate virtual world using a head-mounted display (HMD) with possible CS triggers or to avoid the triggers by avoiding using VR. With the huge success and potential in the entertainment industry, it is very important to focus on the solutions to handling CS dilemmas. Therefore, the main observation for the developers is to have a guide around the set of established design principles aiming to broadly reduce CS. In this paper, we provide a method to apply artificial intelligence (AI) techniques and use machine learning (ML) algorithms including support vector machines (SVMs), decision trees (DTs) and K-nearest neighbours (KNNs) to predict CS outcomes. Based on our findings, we have observed that DT and SVM surpassed KNN in test accuracy. Additionally, DT exhibited better results than both SVM and KNN in train accuracy. By exploiting the power of ML, developers will be able to predict the potential occurrence of CS while developing VR projects to find ways to alleviate CS more effectively.

computer science, interdisciplinary applications, software engineering,imaging science & photographic technology
Exploring Quantitative Assessment of Cybersickness in Virtual Reality Using EEG Signals and a CNN-LSTM Network

Mengdie Xu,Mutian Liu,P. Zan,Banghua Yang,Xinxing Xia

DOI: https://doi.org/10.1109/VRW58643.2023.00256

2023-03-01

Abstract:Cybersickness in the virtual reality (VR) environment poses a significant challenge to the user experience. In this paper, we evaluate VR cybersickness quantitatively based on electroencephalography (EEG). We designed a novel experimental paradigm to generate cybersickness based on the virtual rotation of the user's head and collected the corresponding EEG signals. A novel deep learning framework combing a convolutional neural network (CNN) with long short-term memory (LSTM) was proposed to predict cyber-sickness based on the EEG signals. With the proposed method, a meaningful evaluation of cybersickness is achieved. We further investigated the brain frequency-domain physiological characteristics at different levels of cybersickness.

Computer Science,Engineering
Prediction of cybersickness in virtual environments using topological data analysis and machine learning

Azadeh Hadadi,Christophe Guillet,Jean-Rémy Chardonnet,Mikhail Langovoy,Yuyang Wang,Jivka Ovtcharova

DOI: https://doi.org/10.3389/frvir.2022.973236

2022-10-11

Frontiers in Virtual Reality

Abstract:Recent significant progress in Virtual Reality (VR) applications and environments raised several challenges. They proved to have side effects on specific users, thus reducing the usability of the VR technology in some critical domains, such as flight and car simulators. One of the common side effects is cybersickness. Some significant commonly reported symptoms are nausea, oculomotor discomfort, and disorientation. To mitigate these symptoms and consequently improve the usability of VR systems, it is necessary to predict the incidence of cybersickness. This paper proposes a machine learning approach to VR’s cybersickness prediction based on physiological and subjective data. We investigated combinations of topological data analysis with a range of classifier algorithms and assessed classification performance. The highest performance of Topological Data Analysis (TDA) based methods was achieved in combination with SVMs with Gaussian RBF kernel, indicating that Gaussian RBF kernels provide embeddings of physiological time series data into spaces that are rich enough to capture the essential geometric features of this type of data. Comparing several combinations with feature descriptors for physiological time series, the performance of the TDA + SVM combination is in the top group, statistically being on par or outperforming more complex and less interpretable methods. Our results show that heart rate does not seem to correlate with cybersickness.
Multimodal Biosensing for Vestibular Network-Based Cybersickness Detection

Gang Li,Mark Mcgill,Stephen Brewster,Chao Ping Chen,Joaquin Anguera,Adam Gazzaley,Frank Pollick

DOI: https://doi.org/10.1109/jbhi.2021.3134024

IF: 7.7

2021-01-01

IEEE Journal of Biomedical and Health Informatics

Abstract:Virtual reality (VR) has the potential to induce cybersickness (CS), which impedes CS-susceptible VR users from the benefit of emerging VR applications. To better detect CS, the current study investigated whether/how the newly proposed human vestibular network (HVN) is involved in flagship consumer VR-induced CS by simultaneously recording autonomic physiological signals as well as neural signals generated in sensorimotor and cognitive domains. The VR stimuli were made up of one or two moderate CS-inducing entertaining task(s) as well as a mild CS-inducing cognitive task implemented before and after the moderate CS task(s). Results not only showed that CS impaired cognitive control ability, represented by the degree of attentional engagement, but also revealed that combined indicators from all three HVN domains could together establish the best regression relationship with CS ratings. More importantly, we found that every HVN domain had its unique advantage with the dynamic changes in CS severity and time. These results provide evidence for involvement of the HVN in CS and indicate the necessity of HVN-based CS detection.

computer science, interdisciplinary applications,mathematical & computational biology,medical informatics, information systems
VR Sickness Prediction from Integrated HMD's Sensors using Multimodal Deep Fusion Network

Rifatul Islam,Kevin Desai,John Quarles

DOI: https://doi.org/10.48550/arXiv.2108.06437

2021-08-14

Abstract:Virtual Reality (VR) sickness commonly known as cybersickness is one of the major problems for the comfortable use of VR systems. Researchers have proposed different approaches for predicting cybersickness from bio-physiological data (e.g., heart rate, breathing rate, electroencephalogram). However, collecting bio-physiological data often requires external sensors, limiting locomotion and 3D-object manipulation during the virtual reality (VR) experience. Limited research has been done to predict cybersickness from the data readily available from the integrated sensors in head-mounted displays (HMDs) (e.g., head-tracking, eye-tracking, motion features), allowing free locomotion and 3D-object manipulation. This research proposes a novel deep fusion network to predict cybersickness severity from heterogeneous data readily available from the integrated HMD sensors. We extracted 1755 stereoscopic videos, eye-tracking, and head-tracking data along with the corresponding self-reported cybersickness severity collected from 30 participants during their VR gameplay. We applied several deep fusion approaches with the heterogeneous data collected from the participants. Our results suggest that cybersickness can be predicted with an accuracy of 87.77\% and a root-mean-square error of 0.51 when using only eye-tracking and head-tracking data. We concluded that eye-tracking and head-tracking data are well suited for a standalone cybersickness prediction framework.

Human-Computer Interaction
Cybersickness Detection through Head Movement Patterns: A Promising Approach

Masoud Salehi,Nikoo Javadpour,Brietta Beisner,Mohammadamin Sanaei,Stephen B. Gilbert

2024-02-27

Abstract:Despite the widespread adoption of Virtual Reality (VR) technology, cybersickness remains a barrier for some users. This research investigates head movement patterns as a novel physiological marker for cybersickness detection. Unlike traditional markers, head movements provide a continuous, non-invasive measure that can be easily captured through the sensors embedded in all commercial VR headsets. We used a publicly available dataset from a VR experiment involving 75 participants and analyzed head movements across six axes. An extensive feature extraction process was then performed on the head movement dataset and its derivatives, including velocity, acceleration, and jerk. Three categories of features were extracted, encompassing statistical, temporal, and spectral features. Subsequently, we employed the Recursive Feature Elimination method to select the most important and effective features. In a series of experiments, we trained a variety of machine learning algorithms. The results demonstrate a 76% accuracy and 83% precision in predicting cybersickness in the subjects based on the head movements. This study contribution to the cybersickness literature lies in offering a preliminary analysis of a new source of data and providing insight into the relationship of head movements and cybersickness.

Machine Learning,Signal Processing
Automatic Prediction of Cybersickness for Virtual Reality Games

Weina Jin,Jianyu Fan,Diane Gromala,Philippe Pasquier

DOI: https://doi.org/10.1109/gem.2018.8516469

2018-01-01

Abstract:Cybersickness, which is also called Virtual Reality (VR) sickness, poses a significant challenge to the VR user experience. Previous work demonstrated the viability of predicting cybersickness for VR 360°videos. Is it possible to automatically predict the level of cybersickness for interactive VR games? In this paper, we present a machine learning approach to automatically predict the level of cybersickness for VR games. First, we proposed a novel ranking-rating (RR) score to measure the ground-truth annotations for cybersickness. We then verified the RR scores by comparing them with the Simulator Sickness Questionnaire (SSQ) scores. Next, we extracted features from heterogeneous data sources including the VR visual input, the head movement, and the individual characteristics. Finally, we built three machine learning models and evaluated their performances: the Convolutional Neural Network (CNN) trained from scratch, the Long Short-Term Memory Recurrent Neural Networks (LSTM-RNN) trained from scratch, and the Support Vector Regression (SVR). The results indicated that the best performance of predicting cybersickness was obtained by the LSTM-RNN, providing a viable solution for automatically cybersickness prediction for interactive VR games.
Electroencephalogram microstates and functional connectivity of cybersickness

Sungu Nam,Kyoung-Mi Jang,Moonyoung Kwon,Hyun Kyoon Lim,Jaeseung Jeong

DOI: https://doi.org/10.3389/fnhum.2022.857768

2022-08-22

Abstract:Virtual reality (VR) is a rapidly developing technology that simulates the real world. However, for some cybersickness-susceptible people, VR still has an unanswered problem-cybersickness-which becomes the main obstacle for users and content makers. Sensory conflict theory is a widely accepted theory for cybersickness. It proposes that conflict between afferent signals and internal models can cause cybersickness. This study analyzes the brain states that determine cybersickness occurrence and related uncomfortable feelings. Furthermore, we use the electroencephalogram (EEG) microstates and functional connectivity approach based on the sensory conflict theory. The microstate approach is a time-space analysis method that allows signals to be divided into several temporarily stable states, simultaneously allowing for the exploration of short- and long-range signals. These temporal dynamics can show the disturbances in mental processes associated with neurological and psychiatric conditions of cybersickness. Furthermore, the functional connectivity approach gives us in-depth insight and relationships between the sources related to cybersickness. We recruited 40 males (24.1 ± 2.3 years), and they watched a VR video on a curved computer monitor for 10 min to experience cybersickness. We recorded the 5-min resting state EEG (baseline condition) and 10-min EEG while watching the VR video (task condition). Then, we performed a microstate analysis, focusing on two temporal parameters: mean duration and global explained variance (GEV). Finally, we obtained the functional connectivity data using eLoreta and lagged phase synchronization (LPS). We discovered five sets of microstates (A-E), including four widely reported canonical microstates (A-D), during baseline and task conditions. The average duration increased in microstates A and B, which is related to the visual and auditory networks. The GEV and duration decreased in microstate C, whereas those in microstate D increased. Microstate C is related to the default mode network (DMN) and D to the attention network. The temporal dynamics of the microstate parameters are from cybersickness disturbing the sensory, DMN, and attention networks. In the functional connectivity part, the LPS between the left and right parietal operculum (OP) significantly decreased (p < 0.05) compared with the baseline condition. Furthermore, the connectivity between the right OP and V5 significantly decreased (p < 0.05). These results also support the disturbance of the sensory network because a conflict between the visual (V5) and vestibular system (OP) causes cybersickness. Changes in the microstates and functional connectivity support the sensory conflict theory. These results may provide additional information in understanding brain dynamics during cybersickness.
Predicting Cybersickness Using Machine Learning and Demographic Data in Virtual Reality

Ananth N. Ramaseri-Chandra,Hassan Reza

DOI: https://doi.org/10.3390/electronics13071313

IF: 2.9

2024-04-01

Electronics

Abstract:The widespread adoption of virtual reality (VR) technologies is significantly hindered by the prevalence of cybersickness, a disruptive experience causing symptoms like nausea, dizziness, and disorientation. Traditional methodologies for predicting cybersickness predominantly depend on biomedical data. While effective, these methods often require invasive data collection techniques, which can be impractical and pose privacy concerns. Furthermore, existing research integrating demographic information typically does so in conjunction with biomedical or behavioral data, not as a standalone predictive tool. Addressing this gap, we investigated machine learning techniques that exclusively use demographic data to classify and predict the likelihood of cybersickness and its severity in VR environments. This method relies on noninvasive, easily accessible demographic information like age, gender, and previous VR exposure. It offers a more user-friendly and ethically sound approach to predicting cybersickness. The study explores the potential of demographic variables as standalone predictors through comprehensive data analysis, challenging the traditional reliance on biomedical metrics. We comprehensively presented the input data and statistical analysis and later carefully selected the widely used machine learning models from different classes, including k-nearest neighbors, Naive Bayes, Logistic Regression, Random Forest, and Support Vector Machine. We evaluated their performances and presented detailed results and limitations. The research findings indicate that demographic data can be used to predict the likelihood and severity of cybersickness. This research provides critical insights into future research directions, including data collection design and optimization suggestions. It opens new avenues for personalized and inclusive VR design, potentially reducing barriers to VR adoption and enhancing user comfort and safety.

engineering, electrical & electronic,computer science, information systems,physics, applied
A Deep Cybersickness Predictor through Kinematic Data with Encoded Physiological Representation

Ruichen Li,Yuyang Wang,Handi Yin,Jean-Rémy Chardonnet,Pan Hui

DOI: https://doi.org/10.48550/arXiv.2304.05984

2023-12-06

Abstract:Users would experience individually different sickness symptoms during or after navigating through an immersive virtual environment, generally known as cybersickness. Previous studies have predicted the severity of cybersickness based on physiological and/or kinematic data. However, compared with kinematic data, physiological data rely heavily on biosensors during the collection, which is inconvenient and limited to a few affordable VR devices. In this work, we proposed a deep neural network to predict cybersickness through kinematic data. We introduced the encoded physiological representation to characterize the individual susceptibility; therefore, the predictor could predict cybersickness only based on a user's kinematic data without counting on biosensors. Fifty-three participants were recruited to attend the user study to collect multimodal data, including kinematic data (navigation speed, head tracking), physiological signals (e.g., electrodermal activity, heart rate), and Simulator Sickness Questionnaire (SSQ). The predictor achieved an accuracy of 97.8\% for cybersickness prediction by involving the pre-computed physiological representation to characterize individual differences, providing much convenience for the current cybersickness measurement.

Human-Computer Interaction
A Review of Deep Learning Approaches to EEG-Based Classification of Cybersickness in Virtual Reality

Caglar Yildirim

DOI: https://doi.org/10.48550/arXiv.2012.00855

IF: 6.4588

2020-12-01

Human-Computer Interaction

Abstract:Cybersickness is an unpleasant side effect of exposure to a virtual reality (VR) experience and refers to such physiological repercussions as nausea and dizziness triggered in response to VR exposure. Given the debilitating effect of cybersickness on the user experience in VR, academic interest in the automatic detection of cybersickness from physiological measurements has crested in recent years. Electroencephalography (EEG) has been extensively used to capture changes in electrical activity in the brain and to automatically classify cybersickness from brainwaves using a variety of machine learning algorithms. Recent advances in deep learning (DL) algorithms and increasing availability of computational resources for DL have paved the way for a new area of research into the application of DL frameworks to EEG-based detection of cybersickness. Accordingly, this review involved a systematic review of the peer-reviewed papers concerned with the application of DL frameworks to the classification of cybersickness from EEG signals. The relevant literature was identified through exhaustive database searches, and the papers were scrutinized with respect to experimental protocols for data collection, data preprocessing, and DL architectures. The review revealed a limited number of studies in this nascent area of research and showed that the DL frameworks reported in these studies (i.e., DNN, CNN, and RNN) could classify cybersickness with an average accuracy rate of 93%. This review provides a summary of the trends and issues in the application of DL frameworks to the EEG-based detection of cybersickness, with some guidelines for future research.
Detection of virtual reality motion sickness based on EEG using asymmetry of entropy and cross-frequency coupling

Chengcheng Hua,Lining Chai,Zhanfeng Zhou,Jianlong Tao,Ying Yan,Xu Chen,Jia Liu,Rongrong Fu

DOI: https://doi.org/10.1016/j.physbeh.2024.114626

2024-10-01

Abstract:The existence of Virtual Reality Motion Sickness (VRMS) is a key factor restricting the further development of the VR industry, and the premise to solve this problem is to be able to accurately and effectively detect its occurrence. In view of the current lack of high-accuracy and effective detection methods, this paper proposes a VRMS detection method based on entropy asymmetry and cross-frequency coupling value asymmetry of EEG. First of all, the EEG of the four selected pairs of electrodes on the bilateral brain are subjected to Multivariate Variational Mode Decomposition (MVMD) respectively, and three types of entropy values on the low-frequency and high-frequency components are calculated, namely approximate entropy, fuzzy entropy and permutation entropy, as well as three types of phase-amplitude coupling features between the low-frequency and high-frequency components, namely the mean value, standard deviation and correlation coefficient; Secondly, the difference of the entropies and the cross-frequency coupling features between the left electrodes and the right electrodes are calculated; Finally, the final feature set are selected via t-test and fed into the SVM for classification, thus realizing the automatic detection of VRMS. The results show that the three classification indexes under this method, i.e., accuracy, sensitivity and specificity, reach 99.5 %, 99.3 % and 99.7 %, respectively, and the value of the area under the ROC curve reached 1, which proves that this method can be an effective indicator for detecting the occurrence of VRMS.
Examination of Cybersickness in Virtual Reality: The Role of Individual Differences, Effects on Cognitive Functions & Motor Skills, and Intensity Differences During and After Immersion

Panagiotis Kourtesis,Agapi Papadopoulou,Petros Roussos

DOI: https://doi.org/10.48550/arXiv.2310.17344

IF: 6.4588

2023-10-26

Human-Computer Interaction

Abstract:Background: Given that VR is applied in multiple domains, understanding the effects of cyber-sickness on human cognition and motor skills and the factors contributing to cybersickness gains urgency. This study aimed to explore the predictors of cybersickness and its interplay with cognitive and motor skills. Methods: 30 participants, 20-45 years old, completed the MSSQ and the CSQ-VR, and were immersed in VR. During immersion, they were exposed to a roller coaster ride. Before and after the ride, participants responded to CSQ-VR and performed VR-based cognitive and psychomotor tasks. Post-VR session, participants completed the CSQ-VR again. Results: Motion sickness susceptibility, during adulthood, was the most prominent predictor of cybersickness. Pupil dilation emerged as a significant predictor of cybersickness. Experience in videogaming was a significant predictor of both cybersickness and cognitive/motor functions. Cybersickness negatively affected visuospatial working memory and psychomotor skills. Overall cybersickness', nausea and vestibular symptoms' intensities significantly decreased after removing the VR headset. Conclusions: In order of importance, motion sickness susceptibility and gaming experience are significant predictors of cybersickness. Pupil dilation appears as a cybersickness' biomarker. Cybersickness negatively affects visuospatial working memory and psychomotor skills. Cybersickness and its effects on performance should be examined during and not after immersion.
Investigating cortical activity during cybersickness by fNIRS

Sang Seok Yeo,Seo Yoon Park,Seong Ho Yun

DOI: https://doi.org/10.1038/s41598-024-58715-2

IF: 4.6

2024-04-08

Scientific Reports

Abstract:This study investigated brain responses during cybersickness in healthy adults using functional near-infrared spectroscopy (fNIRS). Thirty participants wore a head-mounted display and observed a virtual roller coaster scene that induced cybersickness. Cortical activation during the virtual roller coaster task was measured using fNIRS. Cybersickness symptoms were evaluated using a Simulator Sickness Questionnaire (SSQ) administered after the virtual rollercoaster. Pearson correlations were performed for cybersickness symptoms and the beta coefficients of hemodynamic responses. The group analysis of oxyhemoglobin (HbO) and total hemoglobin (HbT) levels revealed deactivation in the bilateral angular gyrus during cybersickness. In the Pearson correlation analyses, the HbO and HbT beta coefficients in the bilateral angular gyrus had a significant positive correlation with the total SSQ and disorientation. These results indicated that the angular gyrus was associated with cybersickness. These findings suggest that the hemodynamic response in the angular gyrus could be a biomarker for evaluating cybersickness symptoms.

multidisciplinary sciences
Cybersickness in current-generation virtual reality head-mounted displays: systematic review and outlook

Polona Caserman,Augusto Garcia-Agundez,Alvar Gámez Zerban,Stefan Göbel

DOI: https://doi.org/10.1007/s10055-021-00513-6

IF: 4.697

2021-04-10

Virtual Reality

Abstract:Abstract Cybersickness (CS) is a term used to refer to symptoms, such as nausea, headache, and dizziness that users experience during or after virtual reality immersion. Initially discovered in flight simulators, commercial virtual reality (VR) head-mounted displays (HMD) of the current generation also seem to cause CS, albeit in a different manner and severity. The goal of this work is to summarize recent literature on CS with modern HMDs, to determine the specificities and profile of immersive VR-caused CS, and to provide an outlook for future research areas. A systematic review was performed on the databases IEEE Xplore, PubMed, ACM, and Scopus from 2013 to 2019 and 49 publications were selected. A summarized text states how different VR HMDs impact CS, how the nature of movement in VR HMDs contributes to CS, and how we can use biosensors to detect CS. The results of the meta-analysis show that although current-generation VR HMDs cause significantly less CS ( $$p<0.001$$ p < 0.001 ), some symptoms remain as intense. Further results show that the nature of movement and, in particular, sensory mismatch as well as perceived motion have been the leading cause of CS. We suggest an outlook on future research, including the use of galvanic skin response to evaluate CS in combination with the golden standard (Simulator Sickness Questionnaire, SSQ) as well as an update on the subjective evaluation scores of the SSQ.

computer science, interdisciplinary applications, software engineering,imaging science & photographic technology
Prediction of Specific Anxiety Symptoms and Virtual Reality Sickness Using In Situ Autonomic Physiological Signals During Virtual Reality Treatment in Patients With Social Anxiety Disorder: Mixed Methods Study

Joo Young Chun,Hyun-Jin Kim,Ji-Won Hur,Dooyoung Jung,Heon-Jeong Lee,Seung Pil Pack,Sungkil Lee,Gerard Kim,Chung-Yean Cho,Seung-Moo Lee,Hyeri Lee,Seungmoon Choi,Taesu Cheong,Chul-Hyun Cho

DOI: https://doi.org/10.2196/38284

2022-09-16

JMIR Serious Games

Abstract:Background: Social anxiety disorder (SAD) is the fear of social situations where a person anticipates being evaluated negatively. Changes in autonomic response patterns are related to the expression of anxiety symptoms. Virtual reality (VR) sickness can inhibit VR experiences. Objective: This study aimed to predict the severity of specific anxiety symptoms and VR sickness in patients with SAD, using machine learning based on in situ autonomic physiological signals (heart rate and galvanic skin response) during VR treatment sessions. Methods: This study included 32 participants with SAD taking part in 6 VR sessions. During each VR session, the heart rate and galvanic skin response of all participants were measured in real time. We assessed specific anxiety symptoms using the Internalized Shame Scale (ISS) and the Post-Event Rumination Scale (PERS), and VR sickness using the Simulator Sickness Questionnaire (SSQ) during 4 VR sessions (#1, #2, #4, and #6). Logistic regression, random forest, and naïve Bayes classification classified and predicted the severity groups in the ISS, PERS, and SSQ subdomains based on in situ autonomic physiological signal data. Results: The severity of SAD was predicted with 3 machine learning models. According to the F1 score, the highest prediction performance among each domain for severity was determined. The F1 score of the ISS mistake anxiety subdomain was 0.8421 using the logistic regression model, that of the PERS positive subdomain was 0.7619 using the naïve Bayes classifier, and that of total VR sickness was 0.7059 using the random forest model. Conclusions: This study could predict specific anxiety symptoms and VR sickness during VR intervention by autonomic physiological signals alone in real time. Machine learning models can predict the severe and nonsevere psychological states of individuals based on in situ physiological signal data during VR interventions for real-time interactive services. These models can support the diagnosis of specific anxiety symptoms and VR sickness with minimal participant bias. Trial registration: Clinical Research Information Service KCT0003854; https://cris.nih.go.kr/cris/search/detailSearch.do/13508.
Toward Predicting Motion Sickness Using Virtual Reality and a Moving Platform Assessing Brain, Muscles, and Heart Signals

Marco Recenti,Carlo Ricciardi,Romain Aubonnet,Ilaria Picone,Deborah Jacob,Halldór Á. R. Svansson,Sólveig Agnarsdóttir,Gunnar H. Karlsson,Valdís Baeringsdóttir,Hannes Petersen,Paolo Gargiulo

DOI: https://doi.org/10.3389/fbioe.2021.635661

IF: 5.7

2021-04-01

Frontiers in Bioengineering and Biotechnology

Abstract:Motion sickness (MS) and postural control (PC) conditions are common complaints among those who passively travel. Many theories explaining a probable cause for MS have been proposed but the most prominent is the sensory conflict theory, stating that a mismatch between vestibular and visual signals causes MS. Few measurements have been made to understand and quantify the interplay between muscle activation, brain activity, and heart behavior during this condition. We introduce here a novel multimetric system called BioVRSea based on virtual reality (VR), a mechanical platform and several biomedical sensors to study the physiology associated with MS and seasickness. This study reports the results from 28 individuals: the subjects stand on the platform wearing VR goggles, a 64-channel EEG dry-electrode cap, two EMG sensors on the gastrocnemius muscles, and a sensor on the chest that captures the heart rate (HR). The virtual environment shows a boat surrounded by waves whose frequency and amplitude are synchronized with the platform movement. Three measurement protocols are performed by each subject, after each of which they answer the Motion Sickness Susceptibility Questionnaire. Nineteen parameters are extracted from the biomedical sensors (5 from EEG, 12 from EMG and, 2 from HR) and 13 from the questionnaire. Eight binary indexes are computed to quantify the symptoms combining all of them in the Motion Sickness Index (I MS ). These parameters create the MS database composed of 83 measurements. All indexes undergo univariate statistical analysis, with EMG parameters being most significant, in contrast to EEG parameters. Machine learning (ML) gives good results in the classification of the binary indexes, finding random forest to be the best algorithm (accuracy of 74.7 for I MS ). The feature importance analysis showed that muscle parameters are the most relevant, and for EEG analysis, beta wave results were the most important. The present work serves as the first step in identifying the key physiological factors that differentiate those who suffer from MS from those who do not using the novel BioVRSea system. Coupled with ML, BioVRSea is of value in the evaluation of PC disruptions, which are among the most disturbing and costly health conditions affecting humans.

multidisciplinary sciences
Automatic Recommendation of Strategies for Minimizing Discomfort in Virtual Environments

Thiago Porcino,Esteban Clua,Daniela Trevisan,Érick Rodrigues,Alexandre Silva

DOI: https://doi.org/10.48550/arXiv.2006.15432

IF: 6.4588

2020-06-27

Human-Computer Interaction

Abstract:Virtual reality (VR) is an imminent trend in games, education, entertainment, military, and health applications, as the use of head-mounted displays is becoming accessible to the mass market. Virtual reality provides immersive experiences but still does not offer an entirely perfect situation, mainly due to Cybersickness (CS) issues. In this work, we first present a detailed review about possible causes of CS. Following, we propose a novel CS prediction solution. Our system is able to suggest if the user may be entering in the next moments of the application into an illness situation. We use Random Forest classifiers, based on a dataset we have produced. The CSPQ (Cybersickness Profile Questionnaire) is also proposed, which is used to identify the player's susceptibility to CS and the dataset construction. In addition, we designed two immersive environments for empirical studies where participants are asked to complete the questionnaire and describe (orally) the degree of discomfort during their gaming experience. Our data was achieved through 84 individuals on different days, using VR devices. Our proposal also allows us to identify which are the most frequent attributes (causes) in the observed discomfort situations.
Multi-level Stress Assessment from ECG in a Virtual Reality Environment using Multimodal Fusion

Zeeshan Ahmad,Suha Rabbani,Muhammad Rehman Zafar,Syem Ishaque,Sridhar Krishnan,Naimul Khan

DOI: https://doi.org/10.48550/arXiv.2107.04566

2021-07-10

Abstract:ECG is an attractive option to assess stress in serious Virtual Reality (VR) applications due to its non-invasive nature. However, the existing Machine Learning (ML) models perform poorly. Moreover, existing studies only perform a binary stress assessment, while to develop a more engaging biofeedback-based application, multi-level assessment is necessary. Existing studies annotate and classify a single experience (e.g. watching a VR video) to a single stress level, which again prevents design of dynamic experiences where real-time in-game stress assessment can be utilized. In this paper, we report our findings on a new study on VR stress assessment, where three stress levels are assessed. ECG data was collected from 9 users experiencing a VR roller coaster. The VR experience was then manually labeled in 10-seconds segments to three stress levels by three raters. We then propose a novel multimodal deep fusion model utilizing spectrogram and 1D ECG that can provide a stress prediction from just a 1-second window. Experimental results demonstrate that the proposed model outperforms the classical HRV-based ML models (9% increase in accuracy) and baseline deep learning models (2.5% increase in accuracy). We also report results on the benchmark WESAD dataset to show the supremacy of the model.

Machine Learning,Human-Computer Interaction,Signal Processing
Prediction and classification of anxiety-related psychological scale and VR sickness based on autonomic physiological responses during VR treatment in patients with social anxiety disorder

J.Y. Chun,H.-J. Kim,S. Lee,M. Kim,T. Cheong,C.-H. Cho

DOI: https://doi.org/10.1192/j.eurpsy.2022.1479

2022-09-03

European Psychiatry

Abstract:Introduction Social anxiety disorder (SAD) can accompany emotional symptoms as well as physical reactions. The assessment and real-time measurement of SAD is difficult in real-world. Objectives This study aims to predict the severity of specific anxiety states and virtual reality (VR) sickness in SAD patients by a machine learning model based on only quantitative measuring of autonomic physiologic signals during VR therapy sessions. Methods In total, 32 individuals with SAD symptoms were enrolled in VR participatory sessions. We assessed patients' specific anxiety symptoms through Internalized Shame Scale (ISS) and Post-Event Rumination Scale (PERS), and VR sickness through Simulator Sickness Questionnaire (SSQ). Specific anxiety symptoms and VR sickness were divided into severe and non-severe states based on the total score of each scale by K-means clustering. Logistic regression, Random Forest, Naïve Bayes classifier, and Support Vector Machine were used based on the physiological signal data to predict the severity group in subdomains of ISS, PERS, and SSQ. Results Prediction performance (F1 score) for the severity of the ISS mistake anxiety subdomain was higher than other scales with 0.8421. For VR sickness, prediction performance for the severity of the physical subdomain was higher than the non-physical subdomain with 0.7692. Conclusions The study findings present that mistake anxiety and physical sickness could be predicted more accurately by only autonomic physiological signals, suggesting these features are probably associated with autonomic responses. Based on the present study results, we could provide the evidence for predicting the severity of specific anxiety or VR adverse effects only based on in-situ physiological signals. Disclosure No significant relationships.

psychiatry

The effect of mycophenolate mofetil on patients with active non-renal SLE.

Identifying presence of cybersickness symptoms using AI-based predictive learning algorithms

Exploring Quantitative Assessment of Cybersickness in Virtual Reality Using EEG Signals and a CNN-LSTM Network

Prediction of cybersickness in virtual environments using topological data analysis and machine learning

Multimodal Biosensing for Vestibular Network-Based Cybersickness Detection

VR Sickness Prediction from Integrated HMD's Sensors using Multimodal Deep Fusion Network

Cybersickness Detection through Head Movement Patterns: A Promising Approach

Automatic Prediction of Cybersickness for Virtual Reality Games

Electroencephalogram microstates and functional connectivity of cybersickness

Predicting Cybersickness Using Machine Learning and Demographic Data in Virtual Reality

A Deep Cybersickness Predictor through Kinematic Data with Encoded Physiological Representation

A Review of Deep Learning Approaches to EEG-Based Classification of Cybersickness in Virtual Reality

Detection of virtual reality motion sickness based on EEG using asymmetry of entropy and cross-frequency coupling

Examination of Cybersickness in Virtual Reality: The Role of Individual Differences, Effects on Cognitive Functions & Motor Skills, and Intensity Differences During and After Immersion

Investigating cortical activity during cybersickness by fNIRS

Cybersickness in current-generation virtual reality head-mounted displays: systematic review and outlook

Prediction of Specific Anxiety Symptoms and Virtual Reality Sickness Using In Situ Autonomic Physiological Signals During Virtual Reality Treatment in Patients With Social Anxiety Disorder: Mixed Methods Study

Toward Predicting Motion Sickness Using Virtual Reality and a Moving Platform Assessing Brain, Muscles, and Heart Signals

Automatic Recommendation of Strategies for Minimizing Discomfort in Virtual Environments

Multi-level Stress Assessment from ECG in a Virtual Reality Environment using Multimodal Fusion

Prediction and classification of anxiety-related psychological scale and VR sickness based on autonomic physiological responses during VR treatment in patients with social anxiety disorder