The Current Research of Combining Multi-Modal Brain-Computer Interfaces With Virtual Reality

Dong Wen,Bingbing Liang,Yanhong Zhou,Hongqian Chen,Tzyy-Ping Jung
DOI: https://doi.org/10.1109/jbhi.2020.3047836
IF: 7.7
2021-09-01
IEEE Journal of Biomedical and Health Informatics
Abstract:Combing brain-computer interfaces (BCI) and virtual reality (VR) is a novel technique in the field of medical rehabilitation and game entertainment. However, the limitations of BCI such as a limited number of action commands and low accuracy hinder the widespread use of BCI-VR. Recent studies have used hybrid BCIs that combine multiple BCI paradigms and/or the multi-modal biosensors to alleviate these issues, which may become the mainstream of BCIs in the future. The main purpose of this review is to discuss the current status of multi-modal BCI-VR. This study first reviewed the development of the BCI-VR, and explored the advantages and disadvantages of incorporating eye tracking, motor capture, and myoelectric sensing into the BCI-VR system. Then, this study discussed the development trend of the multi-modal BCI-VR, hoping to provide a pathway for further research in this field.
computer science, interdisciplinary applications,mathematical & computational biology,medical informatics, information systems
What problem does this paper attempt to address?