The Current Research of Spatial Cognitive Evaluation and Training with Brain–Computer Interface and Virtual Reality

Yanhong Zhou,Wen Dong,Hangjun Lu,Yao Wang,Yijun Liu,Weiwei Qian,Jingpeng Yuan

DOI: https://doi.org/10.3389/fnins.2019.01439

IF: 4.3

2020-01-01

Frontiers in Neuroscience

Abstract:OPINION article Front. Neurosci., 07 February 2020Sec. Perception Science Volume 13 - 2019 | https://doi.org/10.3389/fnins.2019.01439

What problem does this paper attempt to address?

An Adaptive BCI System for Virtual Navigation

Fan Yang,Weidong Chen,Bian Wu,Yu Qi

DOI: https://doi.org/10.1109/icise.2010.5688650

2010-01-01

Abstract:A brain computer interface (BCI) builds an additional pathway between the brain and external devices. This paper introduces a BCI system combined with virtual reality (VR) technology that allows users to navigate in the virtual apartment by motor imagery. Since performance in online sessions is sometimes found to decrease due to non-stationarity of electroencephalogram (EEG) signals, we proposed a method based on adaptive probabilistic neural network (APNN) to overcome this phenomenon. Online experiments were carried out using the BCI system and offline analysis was conducted to make a comparison among different methods. Online results demonstrated that most subjects were able to perform well on the system, and offline analysis showed that the APNN was comparatively predominant.
Cognitive Effort during Visuospatial Problem Solving in Physical Real World, on Computer Screen, and in Virtual Reality

Raimundo da Silva Soares,Kevin L. Ramirez-Chavez,Altona Tufanoglu,Candida Barreto,João Ricardo Sato,Hasan Ayaz

DOI: https://doi.org/10.3390/s24030977

IF: 3.9

2024-02-03

Sensors

Abstract:Spatial cognition plays a crucial role in academic achievement, particularly in science, technology, engineering, and mathematics (STEM) domains. Immersive virtual environments (VRs) have the growing potential to reduce cognitive load and improve spatial reasoning. However, traditional methods struggle to assess the mental effort required for visuospatial processes due to the difficulty in verbalizing actions and other limitations in self-reported evaluations. In this neuroergonomics study, we aimed to capture the neural activity associated with cognitive workload during visuospatial tasks and evaluate the impact of the visualization medium on visuospatial task performance. We utilized functional near-infrared spectroscopy (fNIRS) wearable neuroimaging to assess cognitive effort during spatial-reasoning-based problem-solving and compared a VR, a computer screen, and a physical real-world task presentation. Our results reveal a higher neural efficiency in the prefrontal cortex (PFC) during 3D geometry puzzles in VR settings compared to the settings in the physical world and on the computer screen. VR appears to reduce the visuospatial task load by facilitating spatial visualization and providing visual cues. This makes it a valuable tool for spatial cognition training, especially for beginners. Additionally, our multimodal approach allows for progressively increasing task complexity, maintaining a challenge throughout training. This study underscores the potential of VR in developing spatial skills and highlights the value of comparing brain data and human interaction across different training settings.

engineering, electrical & electronic,chemistry, analytical,instruments & instrumentation
Spatial Knowledge Acquisition in Virtual and Physical Reality: A Comparative Evaluation

Diego Monteiro,Xian Wang,Hai-Ning Liang,Yiyu Cai

DOI: https://doi.org/10.48550/arXiv.2104.07624

2021-04-16

Abstract:Virtual Reality (VR) head-mounted displays (HMDs) have been studied widely as tools for the most diverse kinds of training activities. One special kind that is the basis for many real-world applications is spatial knowledge acquisition and navigation. For example, knowing well by heart escape routes can be an important factor for firefighters and soldiers. Prior research on how well knowledge acquired in virtual worlds translates to real, physical one has had mixed results, with some suggesting spatial learning in VR is akin to using a regular 2D display. However, VR HMDs have evolved drastically in the last decade, and little is known about how spatial training skills in a simulated environment using up-to-date VR HMDs compares to training in the real world. In this paper, we aim to investigate how people trained in a VR maze compare against those trained in a physical maze in terms of recall of the position of items inside the environment. While our results did not find significant differences in time performance for people who experienced the physical and those who trained in VR, other behavioural factors were different.

Human-Computer Interaction
The Current Research of Combining Multi-Modal Brain-Computer Interfaces With Virtual Reality

Dong Wen,Bingbing Liang,Yanhong Zhou,Hongqian Chen,Tzyy-Ping Jung

DOI: https://doi.org/10.1109/jbhi.2020.3047836

IF: 7.7

2021-09-01

IEEE Journal of Biomedical and Health Informatics

Abstract:Combing brain-computer interfaces (BCI) and virtual reality (VR) is a novel technique in the field of medical rehabilitation and game entertainment. However, the limitations of BCI such as a limited number of action commands and low accuracy hinder the widespread use of BCI-VR. Recent studies have used hybrid BCIs that combine multiple BCI paradigms and/or the multi-modal biosensors to alleviate these issues, which may become the mainstream of BCIs in the future. The main purpose of this review is to discuss the current status of multi-modal BCI-VR. This study first reviewed the development of the BCI-VR, and explored the advantages and disadvantages of incorporating eye tracking, motor capture, and myoelectric sensing into the BCI-VR system. Then, this study discussed the development trend of the multi-modal BCI-VR, hoping to provide a pathway for further research in this field.

computer science, interdisciplinary applications,mathematical & computational biology,medical informatics, information systems
Brain-Based Computer Interfaces in Virtual Reality

Sukun Li,Avery Leider,Meikang Qiu,Keke Gai,Meiqin Liu

DOI: https://doi.org/10.1109/CSCloud.2017.51

2017-01-01

Abstract:Virtual Reality (VR) research is accelerating the development of inexpensive real-time Brain Computer Interface (BCI). Hardware improvements that increase the capability of Virtual Reality displays and Brain Computer wearable sensors have made possible several new software frameworks for developers to use and create applications combining BCI and VR. It also enables multiple sensory pathways for communications with a larger sized data to users' brains. The intersections of these two research paths are accelerating both fields and will drive the needs for an energy-aware infrastructure to support the wider local bandwidth demands in the mobile cloud. In this paper, we complete a survey on BCI in VR from various perspectives, including Electroencephalogram (EEG)-based BCI models, machine learning, and current active platforms. Based on our investigations, the main findings of this survey highlights three major development trends of BCI, which are entertainment, VR, and cloud computing.
An Online Brain-Computer Interface in Mobile Virtual Reality Environments

Zhaolin Yao,Yijun Wang,Chen Yang,Weihua Pei,Xiaorong Gao,Hongda Chen

DOI: https://doi.org/10.3233/ica-180586

IF: 6.137

2019-01-01

Integrated Computer-Aided Engineering

Abstract:The brain-computer interface (BCI) technology provides a potential tool for communication and control in immersive virtual reality (VR) environments. However, implementing a BCI with current VR platforms remains a challenge due to difficulties in system design and electroencephalogram (EEG) analysis. This study aims to explore the feasibility of a steady-state visual evoked potential (SSVEP)-based BCI for applications in room-scale VR with an HTC VIVE headset. A four-class BCI was designed to simulate a cursor control system. Subjects were instructed to perform a cue-guided target selection task during standing or walking on a treadmill at four different speeds (0, 0.45, 0.89, and 1.34 meters per second (m/s)). During the experiment, two fixing modes of visual stimuli (head-fixed and earth-fixed) were presented to the head-mounted display (HMD). The results from a group of 10 subjects indicated that the system worked well regarding classification accuracy. The BCI performance decreased as the walking speed increased. Interestingly, the earth-fixed condition showed significantly higher performance than the head-fixed condition, showing online and offline information transfer rates (ITR5) corresponding to unsupervised and supervised algorithms above 10 bits/min and 21 bits/min, respectively. These results demonstrated the potential of an SSVEP-based BCI for applications in room-scale mobile VR environments.
A P300 Based Online Brain-Computer Interface System for Virtual Hand Control

Wei-dong Chen,Jian-hui Zhang,Ji-cai Zhang,Yi Li,Yu Qi,Yu Su,Bian Wu,Shao-min Zhang,Jian-hua Dai,Xiao-xiang Zheng,Dong-rong Xu

DOI: https://doi.org/10.1631/jzus.c0910530

2010-01-01

Journal of Zhejiang University SCIENCE C

Abstract:Brain-computer interface (BCI) is a communication system that can help lock-in patients to interact with the outside environment by translating brain signals into machine commands. The present work provides a design for a virtual reality (VR) based BCI system that allows human participants to control a virtual hand to make gestures by P300 signals, with a positive peak of potential about 300 ms posterior to the onset of target stimulus. In this virtual environment, the participants can obtain a more immersed experience with the BCI system, such as controlling a virtual hand or walking around in the virtual world. Methods of modeling the virtual hand and analyzing the P300 signals are also described in detail. Template matching and support vector machine were used as the P300 classifier and the experiment results showed that both algorithms perform well in the system. After a short time of practice, most participants could learn to control the virtual hand during the online experiment with greater than 70% accuracy.
A review on brain-computer interfaces based on electrocorticographic signals

QI Yu,WANG Yueming

2015-01-01

Abstract:This paper surveys the background and development of brain-computer interfaces using electrocorticographic signals, discusses key issues on paradigm design, signal recording/processing methods and pattern recognition. In the recent years, electrocorticographic brain-computer interfaces has developed rapidly with remarkable achievements, and its ability in neural decoding has improved progressively. This technology is promising to bring new breakthroughs to motor function reconstruction or rehabilitation, human-computer interaction and other fields, and has high importance in both research and applications.
A Test Setting to Compare Spatial Awareness on Paper and in Virtual Reality Using EEG Signals

Sander Van Goethem,Kimberly Adema,Britt van Bergen,Emilia Viaene,Eva Wenborn,Stijn Verwulgen

DOI: https://doi.org/10.1007/978-3-030-20473-0_20

2019-06-12

Abstract:Spatial awareness and the ability to analyze spatial objects, manipulate them and assess the effect thereof, is a key competence for industrial designers. Skills are gradually built up throughout most educational design programs, starting with exercises on technical drawings and reconstruction or classification of spatial objects from isometric projections and CAD practice. The accuracy in which spatial assignments are conducted and the amount of effort required to fulfill them, highly depend on individual insight, interests and persistence. Thus each individual has its own struggles and learning curve to master the structure of spatial objects in aesthetic and functional design. Virtual reality (VR) is a promising tool to expose subjects to objects with complex spatial structure, and even manipulate and design spatial characteristics of such objects. The advantage of displaying spatial objects in VR, compared to representations by projecting them on a screen or paper, could be that subjects could more accurately assess spatial properties of and object and its full geometrical and/or mechanical complexity, when exposed to that object in VR. Immersive experience of spatial objects, could not only result in faster acquiring spatial insights, but also potentially with less effort. We propose that acquiring spatial insight in VR could leverage individual differences in skills and talents and that under this proposition VR can be used as a promising tool in design education. A first step in underpinning this hypothesis, is acquisition of cognitive workload that can be used and compared both in VR and in a classical teaching context. We use electroencephalography (EEG) to assess brain activity through wearable plug and play headset (Wearable Sensing-DSI 7). This equipment is combined with VR (Oculus). We use QStates classification software to compare brain waves when conducting spatial assessments on paper and in VR. This gives us a measure of cognitive workload, as a ratio of a resulting from subject records with a presumed ‘high’ workload. A total number of eight records of subjects were suited for comparison. No significant difference was found between EEG signals (paried t-test, p = 0.57). However the assessment of cognitive workload was successfully validated through a questionnaire. The method could be used to set up reliable constructs for learning techniques for spatial insights.
Virtual Reality for Neurorehabilitation and Cognitive Enhancement

Danko D. Georgiev,Iva Georgieva,Zhengya Gong,Vijayakumar Nanjappan,Georgi V. Georgiev,Danko Georgiev,Georgi Georgiev

DOI: https://doi.org/10.3390/brainsci11020221

IF: 3.333

2021-02-11

Brain Sciences

Abstract:Our access to computer-generated worlds changes the way we feel, how we think, and how we solve problems. In this review, we explore the utility of different types of virtual reality, immersive or non-immersive, for providing controllable, safe environments that enable individual training, neurorehabilitation, or even replacement of lost functions. The neurobiological effects of virtual reality on neuronal plasticity have been shown to result in increased cortical gray matter volumes, higher concentration of electroencephalographic beta-waves, and enhanced cognitive performance. Clinical application of virtual reality is aided by innovative brain–computer interfaces, which allow direct tapping into the electric activity generated by different brain cortical areas for precise voluntary control of connected robotic devices. Virtual reality is also valuable to healthy individuals as a narrative medium for redesigning their individual stories in an integrative process of self-improvement and personal development. Future upgrades of virtual reality-based technologies promise to help humans transcend the limitations of their biological bodies and augment their capacity to mold physical reality to better meet the needs of a globalized world.

neurosciences
Combining brain-computer interface and virtual reality for rehabilitation in neurological diseases: A narrative review

Dong Wen,Yali Fan,Sheng-Hsiou Hsu,Jian Xu,Yanhong Zhou,Jianxin Tao,Xifa Lan,Fengnian Li

DOI: https://doi.org/10.1016/j.rehab.2020.03.015

Abstract:Background: The traditional rehabilitation for neurological diseases lacks the active participation of patients, its process is monotonous and tedious, and the effects need to be improved. Therefore, a new type of rehabilitation technology with more active participation combining brain-computer interface (BCI) with virtual reality (VR) has developed rapidly in recent years and has been used in rehabilitation in neurological diseases. Objectives: This narrative review analyzed and characterized the development and application of the new training system (BCI-VR) in rehabilitation of neurological diseases from the perspective of the BCI paradigm, to provide a pathway for future research in this field. Methods: The review involved a search of the Web of Science-Science Citation Index/Social Sciences Citation Index and the China National Knowledge Infrastructure databases; 39 papers were selected. Advantages and challenges of BCI-VR - based neurological rehabilitation were analyzed in detail. Results: Most BCI-VR studies included could be classified by 3 major BCI paradigms: motor imagery, P300, and steady-state visual-evoked potential. Integrating VR scenes into BCI systems could effectively promote the recovery process from nervous system injuries as compared with traditional methods. Conclusion: As compared with rehabilitation based on traditional BCI, rehabilitation based on BCI-VR can provide better feedback information for patients and promote the recovery of brain function. By solving the challenges and continual development, the BCI-VR system can be broadly applied to the clinical treatment of various neurological diseases.
Exploring neural efficiency in spatial cognition: A comparative study of 3D visual stimuli in virtual reality across STEM and non-STEM fields

Raimundo da Silva Soares Jr,Amanda Yumi Ambriola Oku,Cândida S F Barreto,João Ricardo Sato

DOI: https://doi.org/10.1016/j.bbr.2024.115288

2025-02-04

Abstract:Spatial cognition plays a crucial role in our daily lives. The relationship between spatial abilities and mathematical performance is well-established, with visuospatial training offering significant benefits in academic STEM (Science, Technology, Engineering, and Mathematics) disciplines. Developing visuospatial training requires an objective evaluation of spatial cognition and consideration of various 3D displays. This study aims to compare the neural efficiency of STEM and non-STEM individuals during mental rotation tasks (MRT) in 3D and 2.5D conditions (pseudo 3D) using virtual reality (VR). For that, we propose a novel integrative assessment of spatial cognition by combining a cost-effective VR headset and functional near-infrared spectroscopy (fNIRS). Overall, the findings reveal that STEM individuals exhibit greater neural efficiency in the dorsolateral prefrontal cortex (PFC) while solving MRT in a VR environment compared to their non-STEM counterparts. Additionally, the study shows that there is no significant difference in performance between 3D and 2.5D stimuli, suggesting that both conditions are equally suitable for MRT in VR. One possible explanation is that immersive VR reduces the distinctions between 3D models and 2.5D images, considering MRT scores and PFC activity. This research underscores the practicality and relevance of using VR and fNIRS to evaluate visuospatial tasks and the potential to identify distinct student learning profiles and enhance spatial skills. Furthermore, it highlights the potential of 2.5D stimuli as a cost-effective alternative for learning applications in VR. Here, we demonstrated that modeling the same task in 3D and 2.5D conditions can compare how humans interact with visuospatial tests, providing insights into applying VR devices to develop spatial skills.
Augmented Cognition via Brainwave Entrainment in Virtual Reality: An Open, Integrated Brain Augmentation in a Neuroscience System Approach

Emanuele Argento,George Papagiannakis,Eva Baka,Michail Maniadakis,Panos Trahanias,Michael Sfakianakis,Ioannis Nestoros

DOI: https://doi.org/10.1007/s41133-017-0005-3

2017-02-28

Augmented Human Research

Abstract:Building on augmented cognition theory and technology, our novel contribution in this work enables accelerated, certain brain functions related to task performance as well as their enhancement. We integrated in an open-source framework, latest immersive virtual reality (VR) head-mounted displays, with the Emotiv EPOC EEG headset in an open neuro- and biofeedback system for cognitive state detection and augmentation. Our novel methodology allows to significantly accelerate content presentation in immersive VR, while lowering brain frequency at alpha level—without losing content retention by the user. In our pilot experiments, we tested our innovative VR platform by presenting to N = 25 subjects a complex 3D maze test and different learning procedures for them on how to exit it. The subjects exposed to our VR-induced entrainment learning technology performed significantly better than those exposed to other “classical” learning procedures. In particular, cognitive task performance augmentation was measured for: learning time, complex navigational skills and decision-making abilities, orientation ability.
Designing a brain-computer interface device for neurofeedback using virtual environments

Nan Yan,Jue Wang,Mingyu Liu,Liang Zong,Yongfeng Jiao,Jing Yue,Ye Lv,Qin Yang,Hai Lan,Zhongye Liu

IF: 2

2008-01-01

Journal of Medical and Biological Engineering

Abstract:From continuous feedback of electroencephalogram ( EEG), people can learn how to change their brain electrical activity by a certain guideline. This technique is known as EEG biofeedback, or neurofeedback. It is a main application of brain-computer interface (BCI) systems in assistive technology, which has been widely used in research and clinical applications. However, there are two major limitations of current neurofeedback systems. One is that monotonous feedback methods cannot attract subjects to focus on them. The other one is that the area of EEG collection is limited in central areas. In response to these problems, a neurofeedback (NFB) system was established in this study, which utilized virtual reality (VR) to create appropriate feedback information in certain scenarios. This system collected three-channel EEG signals from frontal and central areas, and translated spontaneous EEG into "commands" signal which provided communication and control capabilities by virtual environment. This paper describes the system's configuration, hardware and software implementation and signal processing methodology. In addition, a pertinent experiment was performed with successful neurofeedback training sessions in order to test the feasibility and effectness of this system. Integrated visual and auditory-continuous performance test (IVA-CPT) results suggested that the attention of subjects had been strengthened after 20 training sessions. It showed that the NFB system could provide an effective therapy for treating children with attention deficit hyperactivity disorder (ADHD). Further research should be focused on mobile and wireless integration of our instrument, for providing mean more powerful and convenient application to clinical therapy.
Virtual Reality Technology in Cognitive Rehabilitation Application: Bibliometric Analysis

Danni He,Shihua Cao,Yuchao Le,Mengxin Wang,Yanfei Chen,Beiying Qian

DOI: https://doi.org/10.2196/38315

2022-10-20

JMIR Serious Games

Abstract:Background: In recent years, with the development of computer science and medical science, virtual reality (VR) technology has become a promising tool for improving cognitive function. Research on VR-based cognitive training has garnered increasing attention. Objective: This study aimed to investigate the application status, research hot spots, and emerging trends of VR in cognitive rehabilitation over the past 20 years. Methods: Articles on VR-based cognitive rehabilitation from 2001 to 2021 were retrieved from the Web of Science Core Collection. CiteSpace software was used for the visual analysis of authors and countries or regions, and Scimago Graphica software was used for the geographic visualization of published countries or regions. Keywords were clustered using the gCLUTO software. Results: A total of 1259 papers were included. In recent years, research on the application of VR in cognitive rehabilitation has been widely conducted, and the annual publication of relevant literature has shown a positive trend. The main research areas include neuroscience and neurology, psychology, computer science, and rehabilitation. The United States ranked first with 328 papers, and Italy ranked second with 140 papers. Giuseppe Riva, an Italian academic, was the most prolific author with 29 publications. The most frequently cited reference was "Using Reality to Characterize Episodic Memory Profiles in Amnestic Mild Cognitive Impairment and Alzheimer's Disease: Influence of Active and Passive Encoding." The most common keywords used by researchers include "virtual reality," "cognition," "rehabilitation," "performance," and "older adult." The largest source of research funding is from the public sector in the United States. Conclusions: The bibliometric analysis provided an overview of the application of VR in cognitive rehabilitation. VR-based cognitive rehabilitation can be integrated into multiple disciplines. We conclude that, in the context of the COVID-19 pandemic, the development of VR-based telerehabilitation is crucial, and there are still many problems that need to be addressed, such as the lack of consensus on treatment methods and the existence of safety hazards.

public, environmental & occupational health,health care sciences & services,medical informatics
Interactive Brain-Computer System for Assessing Binocular Rivalry and Amblyopia Based on VR

Qinglan Shan,Kaiying Mao,Cheng Yu,Yui Lo,Lanying Li,Qinggan Zeng,Xiaomei Nie,Xiao-Ping Zhang,Yuhan Dong

DOI: https://doi.org/10.1109/icvr55215.2022.9847922

2022-01-01

Abstract:Binocular rivalry (BR) is the competition of two eyes when shown with different patterns, which is regarded as a neurological symptom. Since the interocular suppression of BR is related to amblyopia and affects the development of visual function, it is essential to assess both BR and amblyopia. Conventional methods assessing the severity of neurological symptoms rely on chromatic aberration glasses or stereoscope to display BR patterns and stereoscopic objects. However, glasses and stereoscopes are hard to perform respectively and dynamically with 2D displays. In this paper, we adopt virtual reality (VR) as a proper display and interaction media for separated screens and dynamic stereoscopic vision to develop a BR assessing system. To promote the usability of interocular suppression measurement, we further apply steady-state visual-evoked potential (SSVEP) stimulus in VR head-mounted display (HMD) and integrate the stimuli into virtual environments due to the high information transfer rate and accessibility among brain-computer interface (BCI) of SSVEP. Sixteen (16) subjects took part in the experiment, through which the proposed system is effective for BR measurement and amblyopia rehabilitation and outperforms the conventional methods. The proposed method enjoys the benefit of personalized measurement for BR severity and the degree of amblyopia subjectively.
Enjoy Driving From Thought In A Virtual City

Xin Pan,Zhijun Zhang,Jun Qu,Chunhui Zhao,Yuanqing Li

DOI: https://doi.org/10.23919/ChiCC.2017.8029119

2017-01-01

Abstract:Virtual reality (VR) technology allows users to communicate or interact with a virtual artifact in an immersive simulated environment. Most of the existing virtual reality platform uses standard input devices such as a keyboard and mouse, or through multimodal devices such as a wired glove. In this paper. a novel electroencephalo-graph (EEG) based virtual driving (EEG-VD) prototype is proposed, investigated, and designed. Users can enjoy driving a virtual car in a simulated and realistic city only through brain signals. User's EEG signals are obtained, analyzed, and recognized into control commands, which are used to control a virtual car in a three-dimensional (3D) city environment. The paradigm display of P300 in the proposed EEG-VD system is embedded in the display of VR , to realize closely combination of VR and P300. This guarantees the verisimilitude of the system. In addition, asynchronous BCI paradigm based on P300 signals used in the proposed EEG-VD system realizes a high degree of freedom, which can offer appropriate number of control instructions. In order to verify the effectiveness and performance of the designed EEG-VD system, eight volunteers are asked to drive the car in the 3D city. The experiment result shows that the accuracy of P300 recognition rate is larger than 90%. Most of the users (62.5%) can drive the car without any collisions in the first virtual environment, and all users can drive the car without any collisions in the second virtual environment. The designed system can not only be used as a tool to train a subject of BCI but also be used as a game for enjoying life. Potentially, the system can promote the research of BCI applications.
Framework For Virtual Cognitive Experiment In Virtual Geographic Environments

Fan Zhang,Mingyuan Hu,Weitao Che,Hui Lin,Chaoyang Fang

DOI: https://doi.org/10.3390/ijgi7010036

IF: 3.4

2018-01-01

ISPRS International Journal of Geo-Information

Abstract:Virtual Geographic Environment Cognition is the attempt to understand the human cognition of surface features, geographic processes, and human behaviour, as well as their relationships in the real world. From the perspective of human cognition behaviour analysis and simulation, previous work in Virtual Geographic Environments (VGEs) has focused mostly on representing and simulating the real world to create an 'interpretive' virtual world and improve an individual's active cognition. In terms of reactive cognition, building a user 'evaluative' environment in a complex virtual experiment is a necessary yet challenging task. This paper discusses the outlook of VGEs and proposes a framework for virtual cognitive experiments. The framework not only employs immersive virtual environment technology to create a realistic virtual world but also involves a responsive mechanism to record the user's cognitive activities during the experiment. Based on the framework, this paper presents two potential implementation methods: first, training a deep learning model with several hundred thousand street view images scored by online volunteers, with further analysis of which visual factors produce a sense of safety for the individual, and second, creating an immersive virtual environment and Electroencephalogram (EEG)-based experimental paradigm to both record and analyse the brain activity of a user and explore what type of virtual environment is more suitable and comfortable. Finally, we present some preliminary findings based on the first method.
A New Brain-Computer Interface Paradigm based on Steady-State Visual Evoked Potential of Illusory Pattern Motion Perception

Haochong Wang,Guanghua Xu,Yifan Wu,Chengcheng Han,Sicong Zhang

DOI: https://doi.org/10.1109/URAI.2019.8768577

2019-01-01

Abstract:Steady-state visual evoked potential (SSVEP) is a commonly implemented method in brain computer interfaces (BCIs). The traditional pattern flip paradigm has the disadvantages of easy to fatigue and high stimulation intensity. In the application of brain-controlled virtual reality(VR) systems, there are many problems such as limited by devices and the paradigm induced effect was not good. In this paper, we propose a new SSVEP-BCI paradigm based on illusory pattern motion perception. Using the basic principle of pattern peripheral drift illusion, the visual motion stimulation effect is alternately presented in double-frame graphics, and the accurate SSVEP induction effect. The brain activate degree is greater and the functional connection is stronger. The experimental results show that the new paradigm adaptability is an effective SSVEP-BCI paradigm, and it is not easy to fatigue. It can be applied to brain-controlled virtual reality system and other human-computer interactive systems.
Navigating in Virtual Reality using Thought: The Development and Assessment of a Motor Imagery based Brain-Computer Interface

Behnam Reyhani-Masoleh,Tom Chau

DOI: https://doi.org/10.48550/arXiv.1912.04828

2019-12-11

Abstract:Brain-computer interface (BCI) systems have potential as assistive technologies for individuals with severe motor impairments. Nevertheless, individuals must first participate in many training sessions to obtain adequate data for optimizing the classification algorithm and subsequently acquiring brain-based control. Such traditional training paradigms have been dubbed unengaging and unmotivating for users. In recent years, it has been shown that the synergy of virtual reality (VR) and a BCI can lead to increased user engagement. This study created a 3-class BCI with a rather elaborate EEG signal processing pipeline that heavily utilizes machine learning. The BCI initially presented sham feedback but was eventually driven by EEG associated with motor imagery. The BCI tasks consisted of motor imagery of the feet and left and right hands, which were used to navigate a single-path maze in VR. Ten of the eleven recruited participants achieved online performance superior to chance (p < 0.01), while the majority successfully completed more than 70% of the prescribed navigational tasks. These results indicate that the proposed paradigm warrants further consideration as neurofeedback BCI training tool. A paradigm that allows users, from their perspective, control from the outset without the need for prior data collection sessions.

Signal Processing,Neurons and Cognition

The Current Research of Spatial Cognitive Evaluation and Training with Brain–Computer Interface and Virtual Reality

An Adaptive BCI System for Virtual Navigation

Cognitive Effort during Visuospatial Problem Solving in Physical Real World, on Computer Screen, and in Virtual Reality

Spatial Knowledge Acquisition in Virtual and Physical Reality: A Comparative Evaluation

The Current Research of Combining Multi-Modal Brain-Computer Interfaces With Virtual Reality

Brain-Based Computer Interfaces in Virtual Reality

An Online Brain-Computer Interface in Mobile Virtual Reality Environments

A P300 Based Online Brain-Computer Interface System for Virtual Hand Control

A review on brain-computer interfaces based on electrocorticographic signals

A Test Setting to Compare Spatial Awareness on Paper and in Virtual Reality Using EEG Signals

Virtual Reality for Neurorehabilitation and Cognitive Enhancement

Combining brain-computer interface and virtual reality for rehabilitation in neurological diseases: A narrative review

Exploring neural efficiency in spatial cognition: A comparative study of 3D visual stimuli in virtual reality across STEM and non-STEM fields

Augmented Cognition via Brainwave Entrainment in Virtual Reality: An Open, Integrated Brain Augmentation in a Neuroscience System Approach

Designing a brain-computer interface device for neurofeedback using virtual environments

Virtual Reality Technology in Cognitive Rehabilitation Application: Bibliometric Analysis

Interactive Brain-Computer System for Assessing Binocular Rivalry and Amblyopia Based on VR

Enjoy Driving From Thought In A Virtual City

Framework For Virtual Cognitive Experiment In Virtual Geographic Environments

A New Brain-Computer Interface Paradigm based on Steady-State Visual Evoked Potential of Illusory Pattern Motion Perception

Navigating in Virtual Reality using Thought: The Development and Assessment of a Motor Imagery based Brain-Computer Interface