Launching Your VR Neuroscience Laboratory

Ying Choon Wu,Christopher Maymon,Jonathon Paden,Weichen Liu

DOI: https://doi.org/10.1007/7854_2023_420

2024-05-22

Abstract:The proliferation and refinement of affordable virtual reality (VR) technologies and wearable sensors have opened new frontiers in cognitive and behavioral neuroscience. This chapter offers a broad overview of VR for anyone interested in leveraging it as a research tool. In the first section, it examines the fundamental functionalities of VR and outlines important considerations that inform the development of immersive content that stimulates the senses. In the second section, the focus of the discussion shifts to the implementation of VR in the context of the neuroscience lab. Practical advice is offered on adapting commercial, off-theshelf devices to specific research purposes. Further, methods are explored for recording, synchronizing, and fusing heterogeneous forms of data obtained through the VR system or add-on sensors, as well as for labeling events and capturing game play.

Human-Computer Interaction,Neurons and Cognition

What problem does this paper attempt to address?

This paper mainly explores the application of virtual reality (VR) technology in neuroscience research. It aims to provide a comprehensive overview for readers interested in using VR as a research tool. The paper first introduces the basic functions of VR and important factors to consider when developing immersive content, including visual spatial cues, interaction in single and multiplayer virtual spaces, sensory engagement, and immersion. This is followed by a discussion on how to implement VR in a laboratory environment, such as selecting appropriate head-mounted displays (HMD), eye tracking, synchronized recording of multimodal signals, and video capture.

The paper also emphasizes the importance of recording and analyzing different types of data in VR, including behavioral and physiological signals, and explores how to integrate VR systems with biosensors to measure central, peripheral, and autonomic nervous system activity synchronously. In addition, the paper mentions the potential of interdisciplinary collaboration in overcoming technical challenges and fostering innovation, as well as the audience and strategic partnerships to consider when designing projects.

The integration of VR technology in various fields such as experimental research and treatment, art, gaming, and educational tools shows great promise but also presents challenges in data integration and analysis. The paper provides practical recommendations on building an ideal research platform, synchronizing different modalities of data, event marking, and capturing game processes.

Overall, the problem this paper seeks to address is how to effectively utilize VR technology to establish a neuroscience research platform, and the key technologies and methods to consider in achieving this goal.