Abstract:Abstract Brain–computer Interface (BCI) is actively involved in optimizing the communication medium between the human brain and external devices. Objective. Rapid serial visual presentation (RSVP) is a robust and highly efficient BCI technique in recognizing target objects but suffers from limited target selections. Hybrid BCI systems that combine steady-state visual evoked potential (SSVEP) and RSVP can mitigate this limitation and allow users to operate on multiple targets. Approach. This study proposes a novel hybrid SSVEP-RSVP BCI to improve the performance of classifying the target/non-target objects in a multi-target scenario. In this paradigm, SSVEP stimulation helps in identifying the user’s focus location and RSVP stimuli that elicit event-related potentials differentiate target and non-target objects. Main results. The proposed model achieved an offline accuracy of 81.59% by using 12 electroencephalography (EEG) channels and an online (real-time) accuracy of 78.10% when only four EEG channels are considered. Further, the biomarkers of physiological states are analyzed to assess the cognitive states (mental fatigue and user attention) of the participants based on resting theta and alpha band powers. The results indicate an inverse relationship between the BCI performance and the resting EEG power, validating that the subjects’ performance is affected by physiological states for long-term use of the BCI. Significance. Our findings demonstrate that the combination of SSVEP and RSVP stimuli improves the BCI performance and further enhances the possibility of performing multiple user command tasks, which are inevitable in real-world applications. Additionally, the cognitive state biomarkers discussed imply the need for an efficient and attractive experimental paradigm that reduces the physiological state disparities and provide enhanced BCI performance.

A Brain-Computer Interface Based on Multi-Modal Attention

A Multi-Class BCI Based on Somatosensory Imagery

A multi-class tactile brain-computer interface based on stimulus-induced oscillatory dynamics.

Selective Sensation Based Brain-Computer Interface Via Mechanical Vibrotactile Stimulation.

Combining Motor Imagery with Selective Sensation Toward a Hybrid-Modality BCI

Multimodal Brain-Computer Interfaces

Performance of Brain–Computer Interfacing Based on Tactile Selective Sensation and Motor Imagery

Author Response for "single Stimulus Location for Two Inputs: A Combined Brain‐computer Interface Based on Steady State Visual Evoked Potential (SSVEP)"

A Stimulus-Independent Hybrid BCI Based on Motor Imagery and Somatosensory Attentional Orientation

The Validity of Steady-State Visual Evoked Potentials as Attention Tags and Input Signals: A Critical Perspective of Frequency Allocation and Number of Stimuli

An Independent Brain-Computer Interface Using Covert Non-Spatial Visual Selective Attention

Endogenous Sensory Discrimination and Selection by a Fast Brain Switch for a High Transfer Rate Brain-Computer Interface.

SSVEP-assisted RSVP brain–computer interface paradigm for multi-target classification

Brain-computer interface based on intermodulation frequency.

A Novel Hybrid Brain-Computer Interface Combining the Illusion-Induced VEP and SSVEP

A Hybrid Steady-State Visual Evoked Response-Based Brain-Computer Interface with MEG and EEG

Research on Cross-sensory Information Enhancement Effect Based on the Analysis of Multi-mode Brain Imaging

A Half-Field Stimulation Pattern for SSVEP-based Brain-Computer Interface.

Multimodal EEG and Eye Tracking Feature Fusion Approaches for Attention Classification in Hybrid BCIs

A multimodal approach to estimating vigilance in SSVEP-based BCI

A Novel Stimulation Method for Multi-Class SSVEP-BCI Using Intermodulation Frequencies