Abstract:Recent advances in deep learning have had a methodological and practical impact on brain-computer interface (BCI) research. Among the various deep network architectures, convolutional neural networks (CNNs) have been well suited for spatio-spectral-temporal electroencephalogram (EEG) signal representation learning. Most of the existing CNN-based methods described in the literature extract features at a sequential level of abstraction with repetitive nonlinear operations and involve densely connected layers for classification. However, studies in neurophysiology have revealed that EEG signals carry information in different ranges of frequency components. To better reflect these multi-frequency properties in EEGs, we propose a novel deep multi-scale neural network that discovers feature representations in multiple frequency/time ranges and extracts relationships among electrodes, i.e., spatial representations, for subject intention/condition identification. Furthermore, by completely representing EEG signals with spatio-spectral-temporal information, the proposed method can be utilized for diverse paradigms in both active and passive BCIs, contrary to existing methods that are primarily focused on single-paradigm BCIs. To demonstrate the validity of our proposed method, we conducted experiments on various paradigms of active/passive BCI datasets. Our experimental results demonstrated that the proposed method achieved performance improvements when judged against comparable state-of-the-art methods. Additionally, we analyzed the proposed method using different techniques, such as PSD curves and relevance score inspection to validate the multi-scale EEG signal information capturing ability, activation pattern maps for investigating the learned spatial filters, and t-SNE plotting for visualizing represented features. Finally, we also demonstrated our method's application to real-world problems. Based on our experimental results and analyses, we believe that the proposed-multi-scale neural network can be useful for various BCI paradigms, as a starting model or as a backbone network in any new BCI experiments.

A Novel End-to-End Framework to Image Cortical Networks from EEG

GCNs-Net: A Graph Convolutional Neural Network Approach for Decoding Time-resolved EEG Motor Imagery Signals

Perturbing a Neural Network to Infer Effective Connectivity: Evidence from Synthetic EEG Data

Constructing Large-Scale Cortical Brain Networks from Scalp EEG with Bayesian Nonnegative Matrix Factorization.

Classify EEG and Reveal Latent Graph Structure with Spatio-Temporal Graph Convolutional Neural Network

EEG-GNN: Graph Neural Networks for Classification of Electroencephalogram (EEG) Signals

Exploring Brain Effective Connectivity Networks Through Spatiotemporal Graph Convolutional Models.

Portable Brain-Computer Interface Based on Novel Convolutional Neural Network.

A Long Short-Term Memory Network for Sparse Spatiotemporal EEG Source Imaging

A Novel Method for Constructing EEG Large-Scale Cortical Dynamical Functional Network Connectivity (dfnc): WTCS

EEGNet: a compact convolutional neural network for EEG-based brain–computer interfaces

EEGNet: A Compact Convolutional Network for EEG-based Brain-Computer Interfaces

A GAN model encoded by CapsEEGNet for visual EEG encoding and image reproduction

EEG-NeXt: A Modernized ConvNet for The Classification of Cognitive Activity from EEG

Toward reliable signals decoding for electroencephalogram: A benchmark study to EEGNeX

Constructing EEG Large-Scale Cortical Functional Network Connectivity Based on Brain Atlas by S Estimator

Spatial-Temporal DAG Convolutional Networks for End-to-End Joint Effective Connectivity Learning and Resting-State fMRI Classification

Brain Functional Connectivity Analysis via Graphical Deep Learning

Multi-Scale Neural Network for EEG Representation Learning in BCI

Exploring Brain Connectivity with Spatial-Temporal Graph Neural Networks for Improved EEG Seizure Analysis.

Hi-GCN: A Hierarchical Graph Convolution Network for Graph Embedding Learning of Brain Network and Brain Disorders Prediction.