Augmenting VR/AR Applications with EEG/EOG Monitoring and Oculo-Vestibular Recoupling.

John K. Zao,Tzyy-Ping Jung,Hung-Ming Chang,Tchin Tze Gan,Yu-Te Wang,Yuan-Pin Lin,Wen-Hao Liu,Guang-Yu Zheng,Chin-Kuo Lin,Chia-Hung Lin,Yu-Yi Chien,Fang-Cheng Lin,Yi-Pai Huang,Sergio Jose Rodriguez Mendez,Felipe A. Medeiros
DOI: https://doi.org/10.1007/978-3-319-39955-3_12
2016-01-01
Abstract:Head-mounted virtual reality and augmented reality displays a.k.a. VR/AR goggles created a revolutionary multimedia genre that is seeking ever-broadening applications and novel natural human interfaces. Adding neuromonitoring and neurofeedback to this genre is expected to introduce a new dimension to user interaction with the cyber-world. This study presents the development of a Neuromonitoring VR/AR Goggle armed with electroence-phalo-gram and electrooculogram sensors, programmable milli-Ampere current stimulators and wireless fog/cloud computing support. Beside of its potential use in mitigating cybersickness, this device may have potential applications in augmented cognition ranging from feedback-controlled perceptual training to on-line learning and virtual social interactions. A prototype of the device has been made from a Samsung Gear VR for S6. This study explains its technical design to ensure precision data sampling, synchronous event marking, real-time signal processing and big data cloud computing support. This study also demonstrates the effective-ness in measuring the event-related potentials during a visual oddball experiment.
What problem does this paper attempt to address?