Abstract:Recent advances in deep learning have had a methodological and practical impact on brain-computer interface (BCI) research. Among the various deep network architectures, convolutional neural networks (CNNs) have been well suited for spatio-spectral-temporal electroencephalogram (EEG) signal representation learning. Most of the existing CNN-based methods described in the literature extract features at a sequential level of abstraction with repetitive nonlinear operations and involve densely connected layers for classification. However, studies in neurophysiology have revealed that EEG signals carry information in different ranges of frequency components. To better reflect these multi-frequency properties in EEGs, we propose a novel deep multi-scale neural network that discovers feature representations in multiple frequency/time ranges and extracts relationships among electrodes, i.e., spatial representations, for subject intention/condition identification. Furthermore, by completely representing EEG signals with spatio-spectral-temporal information, the proposed method can be utilized for diverse paradigms in both active and passive BCIs, contrary to existing methods that are primarily focused on single-paradigm BCIs. To demonstrate the validity of our proposed method, we conducted experiments on various paradigms of active/passive BCI datasets. Our experimental results demonstrated that the proposed method achieved performance improvements when judged against comparable state-of-the-art methods. Additionally, we analyzed the proposed method using different techniques, such as PSD curves and relevance score inspection to validate the multi-scale EEG signal information capturing ability, activation pattern maps for investigating the learned spatial filters, and t-SNE plotting for visualizing represented features. Finally, we also demonstrated our method's application to real-world problems. Based on our experimental results and analyses, we believe that the proposed-multi-scale neural network can be useful for various BCI paradigms, as a starting model or as a backbone network in any new BCI experiments.

Multi-ganglion ANN based feature learning with application to P300-BCI signal classification

EEG Recognition Based on Multiple Types of Information by Using Wavelet Packet Transform and Neural Networks

Inter-participant transfer learning with attention based domain adversarial training for P300 detection

Single-trial P300 Classification using PCA with LDA, QDA and Neural Networks

Rapid Face Recognition Based On Single-Trial Event-Related Potential Detection Over Multiple Brains

Multi-band spatial feature extraction and classification for motor imaging EEG signals based on OSFBCSP-GAO-SVM model : EEG signal processing

Bayesian Signal Matching for Transfer Learning in ERP-Based Brain Computer Interface

A comparison of feature extraction strategies using wavelet dictionaries and feature selection methods for single trial P300-based BCI

A P300-Detection Method Based on Logistic Regression and a Convolutional Neural Network

Learning Invariant Patterns Based on a Convolutional Neural Network and Big Electroencephalography Data for Subject-Independent P300 Brain-Computer Interfaces

Leveraging Deep Learning Techniques to Improve P300-Based Brain Computer Interfaces

Adaptive Feature Extraction for EEG Signal Classification

A auto-segmented multi-time window dual-scale neural network for brain-computer interfaces based on event-related potentials

Neural Network-Based Feature Extraction for Multi-Class Motor Imagery Classification

Towards Effective Deep Neural Network Approach for Multi-Trial P300-based Character Recognition in Brain-Computer Interfaces

Research of P300 Feature Extraction Algorithm Based on ICA and Wavelet Transform

Subject-independent EEG classification based on a hybrid neural network

Classification Algorithm for fNIRS-based Brain Signals Using Convolutional Neural Network with Spatiotemporal Feature Extraction Mechanism

Multi-Scale Neural Network for EEG Representation Learning in BCI

A hybrid local-global neural network for visual classification using raw EEG signals

EEG Signal Classification Using Manifold Learning and Matrix-Variate Gaussian Model