Abstract:Recent advances in deep learning have had a methodological and practical impact on brain-computer interface (BCI) research. Among the various deep network architectures, convolutional neural networks (CNNs) have been well suited for spatio-spectral-temporal electroencephalogram (EEG) signal representation learning. Most of the existing CNN-based methods described in the literature extract features at a sequential level of abstraction with repetitive nonlinear operations and involve densely connected layers for classification. However, studies in neurophysiology have revealed that EEG signals carry information in different ranges of frequency components. To better reflect these multi-frequency properties in EEGs, we propose a novel deep multi-scale neural network that discovers feature representations in multiple frequency/time ranges and extracts relationships among electrodes, i.e., spatial representations, for subject intention/condition identification. Furthermore, by completely representing EEG signals with spatio-spectral-temporal information, the proposed method can be utilized for diverse paradigms in both active and passive BCIs, contrary to existing methods that are primarily focused on single-paradigm BCIs. To demonstrate the validity of our proposed method, we conducted experiments on various paradigms of active/passive BCI datasets. Our experimental results demonstrated that the proposed method achieved performance improvements when judged against comparable state-of-the-art methods. Additionally, we analyzed the proposed method using different techniques, such as PSD curves and relevance score inspection to validate the multi-scale EEG signal information capturing ability, activation pattern maps for investigating the learned spatial filters, and t-SNE plotting for visualizing represented features. Finally, we also demonstrated our method's application to real-world problems. Based on our experimental results and analyses, we believe that the proposed-multi-scale neural network can be useful for various BCI paradigms, as a starting model or as a backbone network in any new BCI experiments.

A Multi-Scale Activity Transition Network for Data Translation in EEG Signals Decoding

Multi-Scale Neural Network for EEG Representation Learning in BCI

A Robust 3D-Convolutional Neural Network-Based Electroencephalogram Decoding Model for the Intra-Individual Difference

Decoding Silent Reading EEG Signals Using Adaptive Feature Graph Convolutional Network

Structure invariance-driven collaborative contrastive network for EEG decoding

Learning joint space-time-frequency features for EEG decoding on small labeled data

A novel deep transfer learning framework integrating general and domain-specific features for EEG-based brain–computer interface

Silent EEG Classification Using Cross-Fusion Adaptive Graph Convolution Network for Multilingual Neurolinguistic Signal Decoding.

A Multi-Domain Convolutional Neural Network for EEG-Based Motor Imagery Decoding

EEGDnet: Fusing Non-Local and Local Self-Similarity for 1-D EEG Signal Denoising with 2-D Transformer

Transformer-based Spatial-Temporal Feature Learning for EEG Decoding

Fully end-to-end EEG to speech translation using multi-scale optimized dual generative adversarial network with cycle-consistency loss

EEGNet: a compact convolutional neural network for EEG-based brain–computer interfaces

MSVTNet: Multi-Scale Vision Transformer Neural Network for EEG-Based Motor Imagery Decoding

Translating Mental Imaginations into Characters with Codebooks and Dynamics-Enhanced Decoding

A Multi-Scale Fusion Convolutional Neural Network Based on Attention Mechanism for the Visualization Analysis of EEG Signals Decoding

EEGNet: A Compact Convolutional Network for EEG-based Brain-Computer Interfaces

Dual-TSST: A Dual-Branch Temporal-Spectral-Spatial Transformer Model for EEG Decoding

Decoding Bilingual EEG Signals With Complex Semantics Using Adaptive Graph Attention Convolutional Network

EEG-NeXt: A Modernized ConvNet for The Classification of Cognitive Activity from EEG

EEGDnet: Fusing non-local and local self-similarity for EEG signal denoising with transformer