Towards the Automatic Detection of Vection in Virtual Reality Using EEG

Gaël Van der Lee,Anatole Lécuyer,Maxence Naud,Reinhold Scherer,François Cabestaing,Hakim Si-Mohammed
2024-12-24
Abstract:Vection, the visual illusion of self-motion, provides a strong marker of the VR user experience and plays an important role in both presence and cybersickness. Traditional measurements have been conducted using questionnaires, which exhibit inherent limitations due to their subjective nature and preventing real-time adjustments. Detecting vection in real time would allow VR systems to adapt to users' needs, improving comfort and minimizing negative effects like motion sickness. This paper investigates the presence of vection markers in electroencephalogram (EEG) brain signals using evoked potentials (brain responses to external stimulations). We designed a VR experiment that induces vection using two conditions: (1) forward acceleration or (2) backward acceleration. We recorded both electroencephalographic (EEG) signals and gathered subjective reports on thirty (30) participants. We found an evoked potential of vection characterized by a positive peak around 600 ms (P600) after stimulus onset in the parietal region and a simultaneous negative peak in the frontal region. Our results also found participant variability in sensitivity to vection and cybersickness and EEG markers of acceleration across subjects. This result is promising for potential detection of vection using EEG and paves the way for future studies towards a better understanding of vection. It also provides insights into the functional role of the visual system and its integration with the vestibular system during motion-perception. It has the potential to help enhance VR user experience by qualifying users' perceived vection and adapting the VR environments accordingly.
Human-Computer Interaction,Neurons and Cognition
What problem does this paper attempt to address?
### What problem does this paper attempt to solve? This paper aims to solve the problem of automatic detection of vection (visually - induced self - motion illusion) in virtual reality (VR). Specifically, the author attempts to objectively detect the occurrence of vection through evoked potentials (EPs) in electroencephalogram (EEG) signals. This research addresses the following key issues: 1. **Limitations of subjective measurement**: - Current research mainly relies on subjective measurement methods such as questionnaires, which have inherent limitations, such as individual differences, difficulty in real - time adjustment, and vulnerability to the influence of experimenters. - Subjective measurement cannot provide real - time feedback and is difficult to be dynamically adjusted to adapt to the actual experience of users. 2. **Lack of objective measurement means**: - Evoked potentials (EPs) related to subjective vection have not been reported in the existing literature yet, so it is urgent to develop a reliable objective measurement method. - Objective measurement means can improve the accuracy and consistency of data and provide a scientific basis for the optimization of VR systems. 3. **Improve user comfort and reduce cybersickness**: - Real - time detection of vection can help VR systems make dynamic adjustments according to the user's response, thereby improving user comfort and reducing the occurrence of cybersickness. - By identifying the sensitivity differences of different users, VR systems can adjust environmental parameters more accurately to meet personalized needs. 4. **Understand the neural mechanism**: - Studying the neural mechanism of vection is helpful to deeply understand how the brain processes the integration of the visual and vestibular systems and how to perceive motion. - This is of great significance for revealing the resolution mechanism of sensory conflict, judging speed and direction, etc. ### Main contributions of the paper - **Discover new EEG markers**: The paper discovered specific EEG markers related to vection, namely the positive peak that appears approximately 600 milliseconds (P600) after the start of the stimulus and the simultaneous negative peak in the frontal region. - **Verify the results in the literature**: Replicated the results in the literature on the influence of acceleration signals and vection on alpha - wave power. - **Reveal individual differences**: Discovered the different sensitivities of participants to vection and acceleration directions. - **Establish the relationship with cybersickness**: Found the association between vection and the answers to the Simulator Sickness Questionnaire (SSQ). Through these contributions, this research provides important references and support for further exploring the neural basis of vection and its practical applications in VR applications in the future.