Abstract:Recent advances in deep learning have had a methodological and practical impact on brain-computer interface (BCI) research. Among the various deep network architectures, convolutional neural networks (CNNs) have been well suited for spatio-spectral-temporal electroencephalogram (EEG) signal representation learning. Most of the existing CNN-based methods described in the literature extract features at a sequential level of abstraction with repetitive nonlinear operations and involve densely connected layers for classification. However, studies in neurophysiology have revealed that EEG signals carry information in different ranges of frequency components. To better reflect these multi-frequency properties in EEGs, we propose a novel deep multi-scale neural network that discovers feature representations in multiple frequency/time ranges and extracts relationships among electrodes, i.e., spatial representations, for subject intention/condition identification. Furthermore, by completely representing EEG signals with spatio-spectral-temporal information, the proposed method can be utilized for diverse paradigms in both active and passive BCIs, contrary to existing methods that are primarily focused on single-paradigm BCIs. To demonstrate the validity of our proposed method, we conducted experiments on various paradigms of active/passive BCI datasets. Our experimental results demonstrated that the proposed method achieved performance improvements when judged against comparable state-of-the-art methods. Additionally, we analyzed the proposed method using different techniques, such as PSD curves and relevance score inspection to validate the multi-scale EEG signal information capturing ability, activation pattern maps for investigating the learned spatial filters, and t-SNE plotting for visualizing represented features. Finally, we also demonstrated our method's application to real-world problems. Based on our experimental results and analyses, we believe that the proposed-multi-scale neural network can be useful for various BCI paradigms, as a starting model or as a backbone network in any new BCI experiments.

Predicting Human Intention-Behavior Through EEG Signal Analysis Using Multi-Scale CNN

Multi-Scale Neural Network for EEG Representation Learning in BCI

A Simplified CNN Classification Method for MI-EEG via the Electrode Pairs Signals

A hybrid local-global neural network for visual classification using raw EEG signals

Multiscale space-time-frequency feature-guided multitask learning CNN for motor imagery EEG classification

Cascade and Parallel Convolutional Recurrent Neural Networks on EEG-based Intention Recognition for Brain Computer Interface

EEG-DCNet: A Fast and Accurate MI-EEG Dilated CNN Classification Method

EEG-based intention recognition with deep recurrent-convolution neural network: Performance and channel selection by Grad-CAM

Making Sense of Spatio-Temporal Preserving Representations for EEG-Based Human Intention Recognition.

Multi-Scale Spatiotemporal Attention Network for Neuron based Motor Imagery EEG Classification

EEG temporal information-based 1-D convolutional neural network for motor imagery classification

A Multi-Channel Feature Fusion CNN-Bi-LSTM Epilepsy EEG Classification and Prediction Model Based on Attention Mechanism

Inter-subject transfer learning with an end-to-end deep convolutional neural network for EEG-based BCI

Know Your Mind: Adaptive Brain Signal Classification with Reinforced Attentive Convolutional Neural Networks

Classification Algorithm for fNIRS-based Brain Signals Using Convolutional Neural Network with Spatiotemporal Feature Extraction Mechanism

An end-to-end CNN with attentional mechanism applied to raw EEG in a BCI classification task

High-Order Temporal Convolutional Network for Improving Classification Performance of SSVEP-EEG

An intertwined neural network model for EEG classification in brain-computer interfaces

Less is More: Brain Functional Connectivity Empowered Generalisable Intention Classification with Task-relevant Channel Selection

A Method for the Spatial Interpolation of EEG Signals Based on the Bidirectional Long Short-Term Memory Network

Task-State EEG Signal Classification for Spatial Cognitive Evaluation Based on Multiscale High-Density Convolutional Neural Network