Minimal access surgery of ascending and proximal arch of the aorta: a 9-year experience.

M. Tabata,Z. Khalpey,S. Aranki,G. Couper,L. Cohn,P. Shekar

DOI: https://doi.org/10.1016/J.ATHORACSUR.2007.03.029

2007-07-01

Abstract:

What problem does this paper attempt to address?

Combining Motor Imagery with Selective Sensation Toward a Hybrid-Modality BCI

Lin Yao,Jianjun Meng,Dingguo Zhang,Xinjun Sheng,Xiangyang Zhu

DOI: https://doi.org/10.1109/tbme.2013.2287245

2014-01-01

Abstract:A hybrid modality brain-computer interface (BCI) is proposed in this paper, which combines motor imagery with selective sensation to enhance the discrimination between left and right mental tasks, e. g., the classification between left/right stimulation sensation and right/left motor imagery. In this paradigm, wearable vibrotactile rings are used to stimulate both the skin on both wrists. Subjects are required to perform the mental tasks according to the randomly presented cues (i.e., left hand motor imagery, right hand motor imagery, left stimulation sensation or right stimulation sensation). Two-way ANOVA statistical analysis showed a significant group effect (F (2,20) = 7.17, p = 0.0045), and the Benferroni-corrected multiple comparison test (with alpha = 0.05) showed that the hybrid modality group is 11.13% higher on average than the motor imagery group, and 10.45% higher than the selective sensation group. The hybrid modality experiment exhibits potentially wider spread usage within ten subjects crossed 70% accuracy, followed by four subjects in motor imagery and five subjects in selective sensation. Six subjects showed statistically significant improvement (p < 0.0045 Benferroni-corrected) in hybrid modality in comparison with both motor imagery and selective sensation. Furthermore, among subjects having difficulties in both motor imagery and selective sensation, the hybrid modality improves their performance to 90% accuracy. The proposed hybrid modality BCI has demonstrated clear benefits for those poorly performing BCI users. Not only does the requirement of motor and sensory anticipation in this hybrid modality provide basic function of BCI for communication and control, it also has the potential for enhancing the rehabilitation during motor recovery.
A Stimulus-Independent Hybrid BCI Based on Motor Imagery and Somatosensory Attentional Orientation

Lin Yao,Xinjun Sheng,Dingguo Zhang,Ning Jiang,Natalie Mrachacz-Kersting,Xiangyang Zhu,Dario Farina

DOI: https://doi.org/10.1109/tnsre.2017.2684084

IF: 4.9

2017-01-01

IEEE Transactions on Neural Systems and Rehabilitation Engineering

Abstract:Distinctive EEG signals from the motor and somatosensory cortex are generated during mental tasks of motor imagery (MI) and somatosensory attentional orientation (SAO). In this paper, we hypothesize that a combination of these two signal modalities provides improvements in a brain–computer interface (BCI) performance with respect to using the two methods separately, and generate novel types of multi-class BCI systems. Thirty two subjects were randomly divided into a Control-Group and a Hybrid-Group. In the Control-Group, the subjects performed left and right hand motor imagery (i.e., L-MI and R-MI). In the Hybrid-Group, the subjects performed the four mental tasks (i.e., L-MI, R-MI, L-SAO, and R-SAO). The results indicate that combining two of the tasks in a hybrid manner (such as L-SAO and R-MI) resulted in a significantly greater classification accuracy than when using two MI tasks. The hybrid modality reached 86.1% classification accuracy on average, with a 7.70% increase with respect to MI ( ${\mathrm {P}}<0.01$ ), and 7.21% to SAO ( ${\mathrm {P}}<0.01$ ) alone. Moreover, all 16 subjects in the hybrid modality reached at least 70% accuracy, which is considered the threshold for BCI illiteracy. In addition to the two-class results, the classification accuracy was 68.1% and 54.1% for the three-class and four-class hybrid BCI. Combining the induced brain signals from motor and somatosensory cortex, the proposed stimulus-independent hybrid BCI has shown improved performance with respect to individual modalities, reducing the portion of BCI-illiterate subjects, and provided novel types of multi-class BCIs.
A Robotic Arm Control System with Simultaneous and Sequential Modes Combining Eye-Tracking with Steady-State Visual Evoked Potential in Virtual Reality Environment.

Rongxiao Guo,Yanfei Lin,Xi Luo,Xiaorong Gao,Shangen Zhang

DOI: https://doi.org/10.3389/fnbot.2023.1146415

IF: 3.493

2023-01-01

Frontiers in Neurorobotics

Abstract:At present, single-modal brain-computer interface (BCI) still has limitations in practical application, such as low flexibility, poor autonomy, and easy fatigue for subjects. This study developed an asynchronous robotic arm control system based on steady-state visual evoked potentials (SSVEP) and eye-tracking in virtual reality (VR) environment, including simultaneous and sequential modes. For simultaneous mode, target classification was realized by decision-level fusion of electroencephalography (EEG) and eye-gaze. The stimulus duration for each subject was non-fixed, which was determined by an adjustable window method. Subjects could autonomously control the start and stop of the system using triple blink and eye closure, respectively. For sequential mode, no calibration was conducted before operation. First, subjects’ gaze area was obtained through eye-gaze, and then only few stimulus blocks began to flicker. Next, target classification was determined using EEG. Additionally, subjects could reject false triggering commands using eye closure. In this study, the system effectiveness was verified through offline experiment and online robotic-arm grasping experiment. Twenty subjects participated in offline experiment. For simultaneous mode, average ACC and ITR at the stimulus duration of 0.9 s were 90.50% and 60.02 bits/min, respectively. For sequential mode, average ACC and ITR at the stimulus duration of 1.4 s were 90.47% and 45.38 bits/min, respectively. Fifteen subjects successfully completed the online tasks of grabbing balls in both modes, and most subjects preferred the sequential mode. The proposed hybrid brain-computer interface (h-BCI) system could increase autonomy, reduce visual fatigue, meet individual needs, and improve the efficiency of the system.
A Hybrid Brain-Computer Interface Control Strategy in a Virtual Environment

Yu Su,Yu Qi,Jian-xun Luo,Bian Wu,Fan Yang,Yi Li,Yue-ting Zhuang,Xiao-xiang Zheng,Wei-dong Chen

DOI: https://doi.org/10.1631/jzus.c1000208

2011-01-01

Abstract:This paper presents a hybrid brain-computer interface （BCI） control strategy,the goal of which is to expand control functions of a conventional motor imagery or a P300 potential based BCI in a virtual environment.The hybrid control strategy utilizes P300 potential to control virtual devices and motor imagery related sensorimotor rhythms to navigate in the virtual world.The two electroencephalography （EEG） patterns serve as source signals for different control functions in their corresponding system states,and state switch is achieved in a sequential manner.In the current system,imagination of left/right hand movement was translated into turning left/right in the virtual apartment continuously,while P300 potentials were mapped to discrete virtual device control commands using a five-oddball paradigm.The combination of motor imagery and P300 patterns in one BCI system for virtual environment control was tested and the results were compared with those of a single motor imagery or P300-based BCI.Subjects obtained similar performances in the hybrid and single control tasks,which indicates the hybrid control strategy works well in the virtual environment.
An online hybrid BCI system based on SSVEP and EMG

Ke Lin,Andrea Cinetto,Yijun Wang,Xiaogang Chen,Shangkai Gao,Xiaorong Gao

DOI: https://doi.org/10.1088/1741-2560/13/2/026020

IF: 5.043

2016-02-23

Journal of Neural Engineering

Abstract:OBJECTIVE: A hybrid brain-computer interface (BCI) is a device combined with at least one other communication system that takes advantage of both parts to build a link between humans and machines. To increase the number of targets and the information transfer rate (ITR), electromyogram (EMG) and steady-state visual evoked potential (SSVEP) were combined to implement a hybrid BCI. A multi-choice selection method based on EMG was developed to enhance the system performance.APPROACH: A 60-target hybrid BCI speller was built in this study. A single trial was divided into two stages: a stimulation stage and an output selection stage. In the stimulation stage, SSVEP and EMG were used together. Every stimulus flickered at its given frequency to elicit SSVEP. All of the stimuli were divided equally into four sections with the same frequency set. The frequency of each stimulus in a section was different. SSVEPs were used to discriminate targets in the same section. Different sections were classified using EMG signals from the forearm. Subjects were asked to make different number of fists according to the target section. Canonical Correlation Analysis (CCA) and mean filtering was used to classify SSVEP and EMG separately. In the output selection stage, the top two optimal choices were given. The first choice with the highest probability of an accurate classification was the default output of the system. Subjects were required to make a fist to select the second choice only if the second choice was correct.MAIN RESULTS: The online results obtained from ten subjects showed that the mean accurate classification rate and ITR were 81.0% and 83.6 bits min(-1) respectively only using the first choice selection. The ITR of the hybrid system was significantly higher than the ITR of any of the two single modalities (EMG: 30.7 bits min(-1), SSVEP: 60.2 bits min(-1)). After the addition of the second choice selection and the correction task, the accurate classification rate and ITR was enhanced to 85.8% and 90.9 bit min(-1).SIGNIFICANCE: These results suggest that the hybrid system proposed here is suitable for practical use.

engineering, biomedical,neurosciences
A Novel Hybrid Brain-Computer Interface Combining the Illusion-Induced VEP and SSVEP

Ruxue Li,Xi Zhao,Zhenyu Wang,Guiying Xu,Honglin Hu,Ting Zhou,Tianheng Xu

DOI: https://doi.org/10.1109/TNSRE.2023.3337525

Abstract:Traditional single-modality brain-computer interface (BCI) systems are limited by their reliance on a single characteristic of brain signals. To address this issue, incorporating multiple features from EEG signals can provide robust information to enhance BCI performance. In this study, we designed and implemented a novel hybrid paradigm that combined illusion-induced visual evoked potential (IVEP) and steady-state visual evoked potential (SSVEP) with the aim of leveraging their features simultaneously to improve system efficiency. The proposed paradigm was validated through two experimental studies, which encompassed feature analysis of IVEP with a static paradigm, and performance evaluation of hybrid paradigm in comparison with the conventional SSVEP paradigm. The characteristic analysis yielded significant differences in response waveforms among different motion illusions. The performance evaluation of the hybrid BCI demonstrates the advantage of integrating illusory stimuli into the SSVEP paradigm. This integration effectively enhanced the spatio-temporal features of EEG signals, resulting in higher classification accuracy and information transfer rate (ITR) within a short time window when compared to traditional SSVEP-BCI in four-command task. Furthermore, the questionnaire results of subjective estimation revealed that proposed hybrid BCI offers less eye fatigue, and potentially higher levels of concentration, physical condition, and mental condition for users. This work first introduced the IVEP signals in hybrid BCI system that could enhance performance efficiently, which is promising to fulfill the requirements for efficiency in practical BCI control systems.
A Hybrid Brain-Computer Interface System Based on Motor Imageries and Eye-Blinking.

Jin Liu,Xiaopei Wu,Lei Zhang,Bangyan Zhou

DOI: https://doi.org/10.1007/978-3-030-00563-4_20

2018-01-01

Abstract:This paper focuses on the online implementation of a hybrid brain computer interface (BCI) involving electroculogram (EOG) and electroencephalogram (EEG) of motor imagery (MI). The hybrid BCI system comprises of modules of eye-blinking detection, ICA spatial filter, zero-training classifier and cursor movement controlling. Eye-blinking information contained in EOG signal was achieved for locating EEG segments related to motor imageries. Then, independent component analysis (ICA) was applied to the filtered EEG data to yield the motor-related potentials, whose features were fed into a zero-training classifier. Finally, the classification results regarding the types of moving imagination were transferred into commands to control the cursor moving along a predesigned path shown on the computer screen. Four subjects attended the online BCI tests, the average moving accuracy reached 84.56% for all tests, and the response time was about 4.13 trials/min. The experimental results demonstrate that the hybrid MIBCI system in this study is feasible for the real-time control of peripheral devices.
A Hybrid Steady-State Visual Evoked Response-Based Brain-Computer Interface with MEG and EEG

Xiang Li,Jingjing Chen,Nanlin Shi,Chen Yang,Puze Gao,Xiaogang Chen,Yijun Wang,Shangkai Gao,Xiaorong Gao

DOI: https://doi.org/10.1016/j.eswa.2023.119736

IF: 8.5

2023-01-01

Expert Systems with Applications

Abstract:While recent developments in electroencephalogram (EEG)-based brain-computer interfaces (BCIs) have enabled a bridge between the brain and external devices with relatively high communication speed, there is still room for improvement. Notably, the phenomenon of "BCI illiteracy," which refers to the 15%-30% of people who struggle to type or control devices using BCI, remains unsolved, limiting the practical application of BCI systems. The EEG-based BCIs performance is constrained by the low-quality scalp EEG signals due to the attenuation and distortion of the skull. To address these limitations, this study proposes a hybrid BCI system combining EEG with magnetoencephalogram (MEG), a neuroimaging technology not influenced by the volume conduction effect, to boost BCI performance by enhancing signal quality. Comparative experiments involving 22 subjects showed that the steady-state visual evoked response (SSVER) from MEG has a wider range of effective bandwidth and higher signal-to-noise ratio than EEG. Moreover, differences in the spectral and spatiotemporal characteristics of MEG and EEG explain better performance. Simultaneous MEG-EEG recording experiments suggested that the hybrid MEG-EEG BCI achieved a significantly higher information transfer rate than either modality alone (hybrid: 312 +/- 17 bits/min, MEG: 272 +/- 17 bits/min, EEG: 240 +/- 27 bits/min). Moreover, the 40-target classification ac-curacy of "BCI illiterate" increased from 50% to 95% with the help of MEG. These results highlight the meth-odological advantages of a hybrid MEG-EEG BCI, suggesting a promising paradigm for implementing high-speed BCIs.
Development of a High-speed Mental Spelling System Combining Eye Tracking and SSVEP-based BCI with High Scalability.

Xinyuan Lin,Zhenyi Chen,Kedi Xu,Shaomin Zhang

DOI: https://doi.org/10.1109/embc.2019.8857408

2019-01-01

Abstract:Hybrid brain-computer interfaces (BCIs) have been proved to be more effective in mental control. In this study, a hybrid BCI speller system combining steady-state visual evoked potentials (SSVEPs) and eye tracking has been proposed. In this system, the eye tracker was used to detect eye gaze position for a 3×3 block selection, after that classification of the command was achieved through filter bank canonical correlation analysis (FBCCA) method. Results showed that the 40-classes hybrid speller system outperformed the SSVEP-only method, achieved a mean accuracy of 92.1% and a mean information transfer rate (ITR) of 180.8 bits/min during online experiments, and the scalability of the proposed system also has been tested with larger number of commands.
The hybrid BCI system for movement control by combining motor imagery and moving onset visual evoked potential

Teng Ma,Hui Li,Lili Deng,Hao Yang,Xulin Lv,Peiyang Li,Fali Li,Rui Zhang,Tiejun Liu,Dezhong Yao,Peng Xu

DOI: https://doi.org/10.1088/1741-2552/aa5d5f

IF: 5.043

2017-02-22

Journal of Neural Engineering

Abstract:OBJECTIVE: Movement control is an important application for EEG-BCI (EEG-based brain-computer interface) systems. A single-modality BCI cannot provide an efficient and natural control strategy, but a hybrid BCI system that combines two or more different tasks can effectively overcome the drawbacks encountered in single-modality BCI control.APPROACH: In the current paper, we developed a new hybrid BCI system by combining MI (motor imagery) and mVEP (motion-onset visual evoked potential), aiming to realize the more efficient 2D movement control of a cursor.MAIN RESULT: The offline analysis demonstrates that the hybrid BCI system proposed in this paper could evoke the desired MI and mVEP signal features simultaneously, and both are very close to those evoked in the single-modality BCI task. Furthermore, the online 2D movement control experiment reveals that the proposed hybrid BCI system could provide more efficient and natural control commands.SIGNIFICANCE: The proposed hybrid BCI system is compensative to realize efficient 2D movement control for a practical online system, especially for those situations in which P300 stimuli are not suitable to be applied.

engineering, biomedical,neurosciences
Hybrid brain–computer interface for biomedical cyber-physical system application using wireless embedded EEG systems

Rifai Chai,Ganesh R. Naik,Sai Ho Ling,Hung T. Nguyen

DOI: https://doi.org/10.1186/s12938-016-0303-x

2017-01-07

BioMedical Engineering OnLine

Abstract:BackgroundOne of the key challenges of the biomedical cyber-physical system is to combine cognitive neuroscience with the integration of physical systems to assist people with disabilities. Electroencephalography (EEG) has been explored as a non-invasive method of providing assistive technology by using brain electrical signals.MethodsThis paper presents a unique prototype of a hybrid brain computer interface (BCI) which senses a combination classification of mental task, steady state visual evoked potential (SSVEP) and eyes closed detection using only two EEG channels. In addition, a microcontroller based head-mounted battery-operated wireless EEG sensor combined with a separate embedded system is used to enhance portability, convenience and cost effectiveness. This experiment has been conducted with five healthy participants and five patients with tetraplegia.ResultsGenerally, the results show comparable classification accuracies between healthy subjects and tetraplegia patients. For the offline artificial neural network classification for the target group of patients with tetraplegia, the hybrid BCI system combines three mental tasks, three SSVEP frequencies and eyes closed, with average classification accuracy at 74% and average information transfer rate (ITR) of the system of 27 bits/min. For the real-time testing of the intentional signal on patients with tetraplegia, the average success rate of detection is 70% and the speed of detection varies from 2 to 4 s.

engineering, biomedical
Novel Hybrid Brain-Computer Interface for Virtual Reality Applications Using Steady-State Visual-Evoked Potential-Based Brain–Computer Interface and Electrooculogram-Based Eye Tracking for Increased Information Transfer Rate

Jisoo Ha,Seonghun Park,Chang-Hwan Im

DOI: https://doi.org/10.3389/fninf.2022.758537

2022-02-24

Frontiers in Neuroinformatics

Abstract:Brain–computer interfaces (BCIs) based on electroencephalogram (EEG) have recently attracted increasing attention in virtual reality (VR) applications as a promising tool for controlling virtual objects or generating commands in a “hands-free” manner. Video-oculography (VOG) has been frequently used as a tool to improve BCI performance by identifying the gaze location on the screen, however, current VOG devices are generally too expensive to be embedded in practical low-cost VR head-mounted display (HMD) systems. In this study, we proposed a novel calibration-free hybrid BCI system combining steady-state visual-evoked potential (SSVEP)-based BCI and electrooculogram (EOG)-based eye tracking to increase the information transfer rate (ITR) of a nine-target SSVEP-based BCI in VR environment. Experiments were repeated on three different frequency configurations of pattern-reversal checkerboard stimuli arranged in a 3 × 3 matrix. When a user was staring at one of the nine visual stimuli, the column containing the target stimulus was first identified based on the user’s horizontal eye movement direction (left, middle, or right) classified using horizontal EOG recorded from a pair of electrodes that can be readily incorporated with any existing VR-HMD systems. Note that the EOG can be recorded using the same amplifier for recording SSVEP, unlike the VOG system. Then, the target visual stimulus was identified among the three visual stimuli vertically arranged in the selected column using the extension of multivariate synchronization index (EMSI) algorithm, one of the widely used SSVEP detection algorithms. In our experiments with 20 participants wearing a commercial VR-HMD system, it was shown that both the accuracy and ITR of the proposed hybrid BCI were significantly increased compared to those of the traditional SSVEP-based BCI in VR environment.

neurosciences,mathematical & computational biology
An EEG-/EOG-Based Hybrid Brain-Computer Interface: Application on Controlling an Integrated Wheelchair Robotic Arm System

Qiyun Huang,Zhijun Zhang,Tianyou Yu,Shenghong He,Yuanqing Li

DOI: https://doi.org/10.3389/fnins.2019.01243

IF: 4.3

2019-11-22

Frontiers in Neuroscience

Abstract:Most existing brain-computer Interfaces (BCIs) are designed to control a single assistive device, such as a wheelchair, a robotic arm or a prosthetic limb. However, many daily tasks require combined functions which can only be realized by integrating multiple robotic devices. Such integration raises the requirement of the control accuracy and is more challenging to achieve a reliable control compared with the single device case. In this study, we propose a novel hybrid BCI with high accuracy based on electroencephalogram (EEG) and electrooculogram (EOG) to control an integrated wheelchair robotic arm system. The user turns the wheelchair left/right by performing left/right hand motor imagery (MI), and generates other commands for the wheelchair and the robotic arm by performing eye blinks and eyebrow raising movements. Twenty-two subjects participated in a MI training session and five of them completed a mobile self-drinking experiment, which was designed purposely with high accuracy requirements. The results demonstrated that the proposed hBCI could provide satisfied control accuracy for a system that consists of multiple robotic devices, and showed the potential of BCI-controlled systems to be applied in complex daily tasks.

neurosciences
Human-computer interaction for augmentative communication using a visual feedback system

Jian Zhao,Dan Li,Jing Pu,Yue Meng,Asma Sbeih,Abdulsattar Abdullah Hamad

DOI: https://doi.org/10.1016/j.compeleceng.2022.107874

2022-05-01

Abstract:Brain-computer interface (BCI) has been considered a positive opportunity for schooling, cognitive learning, and remote contact in medical (e.g., neuronal reintegration).One of the most common uses of a computer is creating a brain-computer interface (BCI). This device can read brain activity signals, analyze them, and send out commands to an output device for execution. A BCI could be controlled by any type of brain signal for the most part. Due to the complexity of a head unit, classification precision is lower, costs are higher, and the work is more complicated. BCI is often challenging to use in everyday life. In this research, a Hybrid BCI using a visual feedback system (HBCI-VFS) proposed a control scheme of two brain impulses that take on electrodes and basic activities, requiring the participant to concentrate on stimulation and eye gaze. The stimulation is used to pick instructions by visually producing a steady-state visual evoked potential (SSVEP). The SSVEP control is calibrated by the single eye gaze (collection confirmation) and both eye gaze (i.e., negation and recollection). The neural network architectures are used to extract and analyze functionality in Fourier transformation and confusion for a short time. The findings show that the proposed device can give 38 instructions with a 3 s window period and 98.92% precision via a single bipolar electroencephalogram (EEG) channel.This study introduces a new BCI model based on SSVEP and eye gaze indications for the Smart home application, which could be helpful for Augmentative Communication. The technique presented in this study can support the other BCI-managed applications with high precision, multiple instructions, and fast response.

engineering, electrical & electronic,computer science, interdisciplinary applications, hardware & architecture
[Optimization of two-dimensional high performance liquid chromatographic columns for highly efficient separation of intact proteins].

Guangfeng Hong,Mingxia Gao,Guo-quan Yan,Xia Guan,Qian Tao,Xiangmin Zhang

DOI: https://doi.org/10.3724/SP.J.1123.2012.00158

2010-02-01

Abstract:In order to optimize two-dimensional liquid chromatographic (2D-LC) columns for highly efficient separation of proteins, several liquid chromatographic columns were investigated and evaluated. Weak anion-exchange (WAX) column was chosen as the first dimension because of its extensive protein separation power. By comparison of different WAX chromatographic columns for human liver protein separation, TSKgel DEAE-5PW column was selected as the first dimension of a 2D-LC system. For the second dimension, ten typical reversed-phase (RP) LC columns (250 mm x 4.6 mm, 5 microm, 30 nm) were investigated and evaluated. Their silica based RP stationary phases were butyl (C4), octyl (C8) or octadecyl (C18). To evaluate the retention behavior and non-specific protein adsorption ability of these ten columns, four neutral compounds (uracil, nitrobenzene, naphthalene and fluorene) and three standard proteins (cytochrome C, myoglobin and albumin from chicken egg white) were adopted and separated by RPLC. Meantime, WAX fractions were used to investigate the separation ability of different alkyl-bonded silica stationary phase columns for complex protein samples. By comparison of column separation efficiency, adsorption of intact proteins and sample analysis, Jupiter 300 C4 column was finally employed for its excellent separation ability. Optimization of WAX and RPLC columns offers reliable foundation for the construction of 2D-LC protein separation systems.
A novel multimodal approach for hybrid brain-computer interface

Zhe Sun,Zihao Huang,Feng Duan,Yu Liu

DOI: https://doi.org/10.48550/arXiv.2004.12081

2020-04-25

Abstract:Brain-computer interface (BCI) technologies have been widely used in many areas. In particular, non-invasive technologies such as electroencephalography (EEG) or near-infrared spectroscopy (NIRS) have been used to detect motor imagery, disease, or mental state. It has been already shown in literature that the hybrid of EEG and NIRS has better results than their respective individual signals. The fusion algorithm for EEG and NIRS sources is the key to implement them in real-life applications. In this research, we propose three fusion methods for the hybrid of the EEG and NIRS-based brain-computer interface system: linear fusion, tensor fusion, and $p$th-order polynomial fusion. Firstly, our results prove that the hybrid BCI system is more accurate, as expected. Secondly, the $p$th-order polynomial fusion has the best classification results out of the three methods, and also shows improvements compared with previous studies. For a motion imagery task and a mental arithmetic task, the best detection accuracy in previous papers were 74.20\% and 88.1\%, whereas our accuracy achieved was 77.53\% and 90.19\% . Furthermore, unlike complex artificial neural network methods, our proposed methods are not as computationally demanding.

Human-Computer Interaction,Signal Processing
A P300 Based Online Brain-Computer Interface System for Virtual Hand Control

Wei-dong Chen,Jian-hui Zhang,Ji-cai Zhang,Yi Li,Yu Qi,Yu Su,Bian Wu,Shao-min Zhang,Jian-hua Dai,Xiao-xiang Zheng,Dong-rong Xu

DOI: https://doi.org/10.1631/jzus.c0910530

2010-01-01

Journal of Zhejiang University SCIENCE C

Abstract:Brain-computer interface (BCI) is a communication system that can help lock-in patients to interact with the outside environment by translating brain signals into machine commands. The present work provides a design for a virtual reality (VR) based BCI system that allows human participants to control a virtual hand to make gestures by P300 signals, with a positive peak of potential about 300 ms posterior to the onset of target stimulus. In this virtual environment, the participants can obtain a more immersed experience with the BCI system, such as controlling a virtual hand or walking around in the virtual world. Methods of modeling the virtual hand and analyzing the P300 signals are also described in detail. Template matching and support vector machine were used as the P300 classifier and the experiment results showed that both algorithms perform well in the system. After a short time of practice, most participants could learn to control the virtual hand during the online experiment with greater than 70% accuracy.
A Hybrid Brain-Computer Interface Based on Visual Evoked Potential and Pupillary Response

Lu Jiang,Xiaoyang Li,Weihua Pei,Xiaorong Gao,Yijun Wang

DOI: https://doi.org/10.3389/fnhum.2022.834959

IF: 3.473

2022-01-01

Frontiers in Human Neuroscience

Abstract:Brain-computer interface (BCI) based on steady-state visual evoked potential (SSVEP) has been widely studied due to the high information transfer rate (ITR), little user training, and wide subject applicability. However, there are also disadvantages such as visual discomfort and "BCI illiteracy." To address these problems, this study proposes to use low-frequency stimulations (12 classes, 0.8-2.12 Hz with an interval of 0.12 Hz), which can simultaneously elicit visual evoked potential (VEP) and pupillary response (PR) to construct a hybrid BCI (h-BCI) system. Classification accuracy was calculated using supervised and unsupervised methods, respectively, and the hybrid accuracy was obtained using a decision fusion method to combine the information of VEP and PR. Online experimental results from 10 subjects showed that the averaged accuracy was 94.90 +/- 2.34% (data length 1.5 s) for the supervised method and 91.88 +/- 3.68% (data length 4 s) for the unsupervised method, which correspond to the ITR of 64.35 +/- 3.07 bits/min (bpm) and 33.19 +/- 2.38 bpm, respectively. Notably, the hybrid method achieved higher accuracy and ITR than that of VEP and PR for most subjects, especially for the short data length. Together with the subjects' feedback on user experience, these results indicate that the proposed h-BCI with the low-frequency stimulation paradigm is more comfortable and favorable than the traditional SSVEP-BCI paradigm using the alpha frequency range.
Improving Intention Detection in Single-Trial Classification through Fusion of EEG and Eye-tracker Data

Xianliang Ge,Yunxian Pan,Sujie Wang,Linze Qian,Jingjia Yuan,Jie Xu,Nitish Thakor,Yu Sun

DOI: https://doi.org/10.48550/arXiv.2112.02566

2021-12-05

Abstract:Intention decoding is an indispensable procedure in hands-free human-computer interaction (HCI). Conventional eye-tracking system using single-model fixation duration possibly issues commands ignoring users' real expectation. In the current study, an eye-brain hybrid brain-computer interface (BCI) interaction system was introduced for intention detection through fusion of multi-modal eye-track and ERP (a measurement derived from EEG) features. Eye-track and EEG data were recorded from 64 healthy participants as they performed a 40-min customized free search task of a fixed target icon among 25 icons. The corresponding fixation duration of eye-tracking and ERP were extracted. Five previously-validated LDA-based classifiers (including RLDA, SWLDA, BLDA, SKLDA, and STDA) and the widely-used CNN method were adopted to verify the efficacy of feature fusion from both offline and pseudo-online analysis, and optimal approach was evaluated through modulating the training set and system response duration. Our study demonstrated that the input of multi-modal eye-track and ERP features achieved superior performance of intention detection in the single trial classification of active search task. And compared with single-model ERP feature, this new strategy also induced congruent accuracy across different classifiers. Moreover, in comparison with other classification methods, we found that the SKLDA exhibited the superior performance when fusing feature in offline test (ACC=0.8783, AUC=0.9004) and online simulation with different sample amount and duration length. In sum, the current study revealed a novel and effective approach for intention classification using eye-brain hybrid BCI, and further supported the real-life application of hands-free HCI in a more precise and stable manner.

Human-Computer Interaction,Signal Processing
Author Response for "single Stimulus Location for Two Inputs: A Combined Brain‐computer Interface Based on Steady State Visual Evoked Potential (SSVEP)"

Lu Wang,Zhenhao Zhang,Dan Han,Zhijun Zhang,Zhifang Liu,Wei Liu

DOI: https://doi.org/10.1111/ejn.15030

IF: 3.698

2020-01-01

European Journal of Neuroscience

Abstract:Brain-computer interfaces (BCI) help severely paralyzed people communicate with the outside world. One type of BCI depends on eye movements and has high information transfer (ITR) but is tiring for users and not applicable to people with eye dyskinesia. Conversely, independent BCIs enable attention shifts across visual stimuli without eye movement, but at the cost of a lower ITR. Steady-state visual evoked potential (SSVEP) is an oscillatory brain response and typically used as BCI signal sources because of high signal-to-noise ratio (SNR). Considering the effect of attentional modulation on the SSVEP, we proposed the novel concept of one-to-two BCI to optimize existing problems, wherein the target and other stimuli shared the same location. Specifically, two spatially overlapping stimuli were displayed in the center-of-view field, as in the independent BCI, and participants were required to divide their attention between the right and left visual fields, as in the dependent BCI. Using three different design schemes in two experiments, we aimed to provide a new framework for BCI design by exploring the feasibility of a combined BCI that can realize a single stimulus location for two inputs. The results strongly demonstrated that, even when the targets and distractors overlapped spatially, the former evoked stronger SSVEP responses. Notably, the BCI scheme based on the object-based attention could achieve a recognition rate as high as 83.2% and an ITR of 12.5 bits per minute. The feasibility of a one-to-two BCI design, which simplified the keyboard layout, reduced the attention shift, and relieved user fatigue, was established.

Minimal access surgery of ascending and proximal arch of the aorta: a 9-year experience.

Combining Motor Imagery with Selective Sensation Toward a Hybrid-Modality BCI

A Stimulus-Independent Hybrid BCI Based on Motor Imagery and Somatosensory Attentional Orientation

A Robotic Arm Control System with Simultaneous and Sequential Modes Combining Eye-Tracking with Steady-State Visual Evoked Potential in Virtual Reality Environment.

A Hybrid Brain-Computer Interface Control Strategy in a Virtual Environment

An online hybrid BCI system based on SSVEP and EMG

A Novel Hybrid Brain-Computer Interface Combining the Illusion-Induced VEP and SSVEP

A Hybrid Brain-Computer Interface System Based on Motor Imageries and Eye-Blinking.

A Hybrid Steady-State Visual Evoked Response-Based Brain-Computer Interface with MEG and EEG

Development of a High-speed Mental Spelling System Combining Eye Tracking and SSVEP-based BCI with High Scalability.

The hybrid BCI system for movement control by combining motor imagery and moving onset visual evoked potential

Hybrid brain–computer interface for biomedical cyber-physical system application using wireless embedded EEG systems

Novel Hybrid Brain-Computer Interface for Virtual Reality Applications Using Steady-State Visual-Evoked Potential-Based Brain–Computer Interface and Electrooculogram-Based Eye Tracking for Increased Information Transfer Rate

An EEG-/EOG-Based Hybrid Brain-Computer Interface: Application on Controlling an Integrated Wheelchair Robotic Arm System

Human-computer interaction for augmentative communication using a visual feedback system

[Optimization of two-dimensional high performance liquid chromatographic columns for highly efficient separation of intact proteins].

A novel multimodal approach for hybrid brain-computer interface

A P300 Based Online Brain-Computer Interface System for Virtual Hand Control

A Hybrid Brain-Computer Interface Based on Visual Evoked Potential and Pupillary Response

Improving Intention Detection in Single-Trial Classification through Fusion of EEG and Eye-tracker Data

Author Response for "single Stimulus Location for Two Inputs: A Combined Brain‐computer Interface Based on Steady State Visual Evoked Potential (SSVEP)"