Research on Hybrid Modal Control Nursing Bed System Based on BCI-VT

Pai Wang,Lili Mao,Lei Zhang,Ni Jiang,Xingxing Ji
DOI: https://doi.org/10.1109/itaic58329.2023.10409067
2023-01-01
Abstract:Aiming at the problems of low accuracy and low generalization performance of unimodal brain-computer interfaces, this paper fuses the line-of-sight tracking technology with brain-computer interfaces and proposes a nursing bed control system based on BCI-VT mixed modality (BV-hM). Firstly, personal template-based filter bank typical correlation analysis (it-FBCCA) is designed to recognize SSVEP signals to realize SSVEP-BCI unimodal control of nursing beds; secondly, by integrating efficient channel attention (ECA) and SE attention mechanism, improved CS-MobileNetV3 is proposed to recognize VT signals to realize VT unimodal control of nursing beds; finally BV -hM control of nursing beds is realized by using a voting strategy to adjust SSVEP and VT signal weights using adaptive weights. 5 subjects participated in the online experiment, and the results show that the average control accuracy of BV -hM is as high as 96.54 1.84% and the average ITR is as high as 126.94 1.98 bit/min under the 2s time window; compared to the SSVEP-BCI unimodal and VT unimodal, the average control accuracy is improved by 14.21 % and 5.69%, and the average ITR is improved by 13.72bit/s and 5.15bit/s; indicating that the performance of the BV -hM system is higher than that of the unimodal system in all cases, and the BV-hM system is more reliable.
What problem does this paper attempt to address?