Abstract:Recent advances in deep learning have had a methodological and practical impact on brain-computer interface (BCI) research. Among the various deep network architectures, convolutional neural networks (CNNs) have been well suited for spatio-spectral-temporal electroencephalogram (EEG) signal representation learning. Most of the existing CNN-based methods described in the literature extract features at a sequential level of abstraction with repetitive nonlinear operations and involve densely connected layers for classification. However, studies in neurophysiology have revealed that EEG signals carry information in different ranges of frequency components. To better reflect these multi-frequency properties in EEGs, we propose a novel deep multi-scale neural network that discovers feature representations in multiple frequency/time ranges and extracts relationships among electrodes, i.e., spatial representations, for subject intention/condition identification. Furthermore, by completely representing EEG signals with spatio-spectral-temporal information, the proposed method can be utilized for diverse paradigms in both active and passive BCIs, contrary to existing methods that are primarily focused on single-paradigm BCIs. To demonstrate the validity of our proposed method, we conducted experiments on various paradigms of active/passive BCI datasets. Our experimental results demonstrated that the proposed method achieved performance improvements when judged against comparable state-of-the-art methods. Additionally, we analyzed the proposed method using different techniques, such as PSD curves and relevance score inspection to validate the multi-scale EEG signal information capturing ability, activation pattern maps for investigating the learned spatial filters, and t-SNE plotting for visualizing represented features. Finally, we also demonstrated our method's application to real-world problems. Based on our experimental results and analyses, we believe that the proposed-multi-scale neural network can be useful for various BCI paradigms, as a starting model or as a backbone network in any new BCI experiments.

A Convolution Network of Multi-Windows Spatial-Temporal Feature Analysis for Single-trial EEG Classification in RSVP Task

A deep learning method for single-trial EEG classification in RSVP task based on spatiotemporal features of ERPs

Enhancing the EEG Classification in RSVP Task by Combining Interval Model of ERPs with Spatial and Temporal Regions of Interest.

Single-Trial EEG Classification Using Spatio-Temporal Weighting and Correlation Analysis for RSVP-Based Collaborative Brain Computer Interface.

A Multi-Scale EEGNet for Cross-Subject RSVP-based BCI System.

Spatio-temporal Pattern Analysis for EEG Classification in Rapid Serial Visual Presentation Task

Assembling global and local spatial-temporal filters to extract discriminant information of EEG in RSVP task

A auto-segmented multi-time window dual-scale neural network for brain-computer interfaces based on event-related potentials

High-Order Temporal Convolutional Network for Improving Classification Performance of SSVEP-EEG

Rapid Face Recognition Based On Single-Trial Event-Related Potential Detection Over Multiple Brains

A Spatio-Temporal Method for Extracting Gamma-Band Features to Enhance Classification in a Rapid Serial Visual Presentation Task

An Auto-Segmented Multi-Time Window Dual-Scale Neural Network for Brain-Computer Interfaces Based on Event-Related Potentials

PSAEEGNet: pyramid squeeze attention mechanism-based CNN for single-trial EEG classification in RSVP task

A Temporal-Spectral Fusion Transformer with Subject-Specific Adapter for Enhancing RSVP-BCI Decoding

Attention-Based Parallel Multiscale Convolutional Neural Network for Visual Evoked Potentials EEG Classification.

A Cross-Scale Transformer and Triple-View Attention Based Domain-Rectified Transfer Learning for EEG Classification in RSVP Tasks

Multi-source domain adaptation based tempo-spatial convolution network for cross-subject EEG classification in RSVP task

Compact CNN with Dynamic Window for SSVEP-based BCIs

Phase Preservation Neural Network for Electroencephalography Classification in Rapid Serial Visual Presentation Task

Multirapid Serial Visual Presentation Framework for EEG-Based Target Detection

Multi-Scale Neural Network for EEG Representation Learning in BCI