Abstract:Objective: This study proposes a new hybrid brain-computer interface (BCI) system to improve spelling accuracy and speed by stimulating P300 and steady-state visually evoked potential (SSVEP) in electroencephalography (EEG) signals. Methods: A frequency enhanced row and column (FERC) paradigm is proposed to incorporate the frequency coding into the row and column (RC) paradigm so that the P300 and SSVEP signals can be evoked simultaneously. A flicker (white-black) with a specific frequency from 6.0 to 11.5 Hz with an interval of 0.5 Hz is assigned to one row or column of a 6 × 6 layout, and the row/column flashes are carried out in a pseudorandom sequence. A wavelet and support vector machine (SVM) combination is adopted for P300 detection, an ensemble task-related component analysis (TRCA) method is used for SSVEP detection, and the two detection possibilities are fused using a weight control approach. Results: The implemented BCI speller achieved an accuracy of 94.29% and an information transfer rate (ITR) of 28.64 bit/min averaged across 10 subjects during the online tests. An accuracy of 96.86% is obtained during the offline calibration tests, higher than that of only using P300 (75.29%) or SSVEP (89.13%). The SVM in P300 outperformed the previous linear discrimination classifier and its variants (61.90–72.22%), and the ensemble TRCA in SSVEP outperformed the canonical correlation analysis method (73.33%). Conclusion: The proposed hybrid FERC stimulus paradigm can improve the performance of the speller compared with the classical single stimulus paradigm. The implemented speller can achieve comparable accuracy and ITR to its state-of-the-art counterparts with advanced detection algorithms.

Spelling with non-invasive Brain-Computer Interfaces--current and future trends

Pushing the Communication Speed Limit of a Noninvasive BCI Speller

Progress in Brain-Computer Interface Based on Spontaneous EEG

Non-invasive EEG-based BCI spellers from the beginning to today: a mini-review

Progress in Brain-computer Interface Based on Cortical Evoked Potential

Hybrid Brain–Computer Interface Spellers: A Walkthrough Recent Advances in Signal Processing Methods and Challenges

Brain-Computer Interface Speller Based on Steady-State Visual Evoked Potential: A Review Focusing on the Stimulus Paradigm and Performance

Advances in P300 brain-computer interface spellers: toward paradigm design and performance evaluation

Current trends in hardware and software for brain–computer interfaces (BCIs)

High-speed spelling with a noninvasive brain–computer interface

Brain Computer Interface System, Performance, Challenges and Applications

Brain–computer interfaces for communication and rehabilitation

Non-invasive Brain-Computer Interfaces: State of the Art and Trends

A hybrid P300-SSVEP brain-computer interface speller with a frequency enhanced row and column paradigm

Brain-Computer Interface System Based on P300 Processing with Convolutional Neural Network, Novel Speller, and Low Number of Electrodes

Combining Brain-Computer Interfaces and Assistive Technologies: State-of-the-Art and Challenges

A High-Itr SSVEP-based BCI Speller

Tiny Noise Can Make an EEG-Based Brain-Computer Interface Speller Output Anything

Single-paradigm and hybrid brain computing interfaces and their use by disabled patients

Neural interface technology for human-computer interaction

The Potential for a Speech Brain–Computer Interface Using Chronic Electrocorticography