Abstract:Recently, VR sickness assessment for VR videos is highly demanded in industry and research fields to address VR viewing safety issues. Especially, it is difficult to evaluate VR sickness of individuals due to individual differences. To achieve the challenging goal, we focus on deep feature fusion of sickness-related information. In this paper, we propose a novel deep learning-based assessment framework which estimates VR sickness of individual viewers with VR videos and corresponding physiological responses. We design the content stimulus guider imitating the phenomenon that humans feel VR sickness. The content stimulus guider extracts a deep stimulus feature from a VR video to reflect VR sickness caused by VR videos. In addition, we devise the physiological response guider to encode physiological responses that are acquired while humans experience VR videos. Each physiology sickness feature extractor (EEG, ECG, and GSR) in the physiological response guider is designed to suit their physiological characteristics. Extracted physiology sickness features are then fused into a deep physiology feature that comprehensively reflects individual deviations of VR sickness. Finally, the VR sickness predictor assesses individual VR sickness effectively with the fusion of the deep stimulus feature and the deep physiology feature. To validate the proposed method extensively, we built two benchmark datasets which contain 360-degree VR videos with physiological responses (EEG, ECG, and GSR) and SSQ scores. Experimental results show that the proposed method achieves meaningful correlations with human SSQ scores. Further, we validate the effectiveness of the proposed network designs by conducting analysis on feature fusion and visualization.

The reliability and availability analysis of SEU mitigation techniques in SRAM-based FPGAs

Assessing Individual VR Sickness through Deep Feature Fusion of VR Video and Physiological Response

Mixing in Reverse Optical Flow to Mitigate Vection and Simulation Sickness in Virtual Reality

Real-Time Viewport-Aware Optical Flow Estimation in 360-degree Videos for Visually-Induced Motion Sickness Mitigation

Towards a Better Understanding of VR Sickness: Physical Symptom Prediction for VR Contents

Gaze-contingent adaptation of VR stereo parameters for cybersickness prevention

[Preliminary clinical experience with PiCCO system in children with shock].

Virtual Reality Sickness: A Review of Causes and Measurements

Cybersickness Reduction via Gaze-Contingent Image Deformation

VR Sickness Prediction from Integrated HMD's Sensors using Multimodal Deep Fusion Network

Beyond Feeling Sick: The Visual and Cognitive Aftereffects of Virtual Reality

Book reviews - Stochastic processes and estimation theory with applications

Reducing Cybersickness in 360-Degree Virtual Reality

Virtual Reality Sickness Mitigation Methods: A Comparative Study in a Racing Game

Evaluating Performance and Gameplay of Virtual Reality Sickness Techniques in a First-Person Shooter Game

A review on ergonomics evaluations of virtual reality

Some Experimental Results of Relieving Discomfort in Virtual Reality by Disturbing Feedback Loop in Human Brain

VRCockpit: Mitigating Simulator Sickness in VR Games Using Multiple Egocentric 2D View Frames

Saccade-Contingent Rendering

Investigate the Neuro Mechanisms of Stereoscopic Visual Fatigue

EEG-based analysis of various sensory stimulation effects to reduce visually induced motion sickness in virtual reality