Abstract:Recent advances in deep learning have had a methodological and practical impact on brain-computer interface (BCI) research. Among the various deep network architectures, convolutional neural networks (CNNs) have been well suited for spatio-spectral-temporal electroencephalogram (EEG) signal representation learning. Most of the existing CNN-based methods described in the literature extract features at a sequential level of abstraction with repetitive nonlinear operations and involve densely connected layers for classification. However, studies in neurophysiology have revealed that EEG signals carry information in different ranges of frequency components. To better reflect these multi-frequency properties in EEGs, we propose a novel deep multi-scale neural network that discovers feature representations in multiple frequency/time ranges and extracts relationships among electrodes, i.e., spatial representations, for subject intention/condition identification. Furthermore, by completely representing EEG signals with spatio-spectral-temporal information, the proposed method can be utilized for diverse paradigms in both active and passive BCIs, contrary to existing methods that are primarily focused on single-paradigm BCIs. To demonstrate the validity of our proposed method, we conducted experiments on various paradigms of active/passive BCI datasets. Our experimental results demonstrated that the proposed method achieved performance improvements when judged against comparable state-of-the-art methods. Additionally, we analyzed the proposed method using different techniques, such as PSD curves and relevance score inspection to validate the multi-scale EEG signal information capturing ability, activation pattern maps for investigating the learned spatial filters, and t-SNE plotting for visualizing represented features. Finally, we also demonstrated our method's application to real-world problems. Based on our experimental results and analyses, we believe that the proposed-multi-scale neural network can be useful for various BCI paradigms, as a starting model or as a backbone network in any new BCI experiments.

A General Multi Time Scale Spatiotemporal Compound Model for EEG Classification

EEG Recognition Based on Multiple Types of Information by Using Wavelet Packet Transform and Neural Networks

Exploiting Asymmetric EEG Signals with EFD in Deep Learning Domain for Robust BCI

Multi-Scale Neural Network for EEG Representation Learning in BCI

Multiscale space-time-frequency feature-guided multitask learning CNN for motor imagery EEG classification

A Cross-Space CNN With Customized Characteristics for Motor Imagery EEG Classification

Predicting Human Intention-Behavior Through EEG Signal Analysis Using Multi-Scale CNN

Motor Imagery EEG Decoding Based on Multi-scale Hybrid Networks and Feature Enhancement.

A Simplified CNN Classification Method for MI-EEG via the Electrode Pairs Signals

A Model Combining Multi Branch Spectral-Temporal CNN, Efficient Channel Attention, and LightGBM for MI-BCI Classification

Classification of Motor Imagery Based on Multi-Scale Feature Extraction and the Channel-Temporal Attention Module.

EEG Motor Imagery Classification With Sparse Spectrotemporal Decomposition and Deep Learning

Feature Bands Study of MI Signals Based on FBCSP for CNN.

Research on EEG Feature Extraction and Recognition Method Based on CNN and CSP

[Multi-task motor imagery electroencephalogram classification based on adaptive time-frequency common spatial pattern combined with convolutional neural network].

An intertwined neural network model for EEG classification in brain-computer interfaces

EEG temporal information-based 1-D convolutional neural network for motor imagery classification

Deep CNN Model Based on Serial-Parallel Structure Optimization for Four-Class Motor Imagery EEG Classification.

A Mutli-Scale Spatial-Temporal Convolutional Neural Network with Contrastive Learning for Motor Imagery EEG Classification

Multi-Scale Convolutional Attention and Riemannian Geometry Network for EEG-Based Motor Imagery Classification

Motor Imagery-Based EEG Signals Classification by Combining Temporal and Spatial Deep Characteristics