Abstract:Recent advances in deep learning have had a methodological and practical impact on brain-computer interface (BCI) research. Among the various deep network architectures, convolutional neural networks (CNNs) have been well suited for spatio-spectral-temporal electroencephalogram (EEG) signal representation learning. Most of the existing CNN-based methods described in the literature extract features at a sequential level of abstraction with repetitive nonlinear operations and involve densely connected layers for classification. However, studies in neurophysiology have revealed that EEG signals carry information in different ranges of frequency components. To better reflect these multi-frequency properties in EEGs, we propose a novel deep multi-scale neural network that discovers feature representations in multiple frequency/time ranges and extracts relationships among electrodes, i.e., spatial representations, for subject intention/condition identification. Furthermore, by completely representing EEG signals with spatio-spectral-temporal information, the proposed method can be utilized for diverse paradigms in both active and passive BCIs, contrary to existing methods that are primarily focused on single-paradigm BCIs. To demonstrate the validity of our proposed method, we conducted experiments on various paradigms of active/passive BCI datasets. Our experimental results demonstrated that the proposed method achieved performance improvements when judged against comparable state-of-the-art methods. Additionally, we analyzed the proposed method using different techniques, such as PSD curves and relevance score inspection to validate the multi-scale EEG signal information capturing ability, activation pattern maps for investigating the learned spatial filters, and t-SNE plotting for visualizing represented features. Finally, we also demonstrated our method's application to real-world problems. Based on our experimental results and analyses, we believe that the proposed-multi-scale neural network can be useful for various BCI paradigms, as a starting model or as a backbone network in any new BCI experiments.

Attention model of EEG signals based on reinforcement learning

Maximum Correntropy Based Attention-Gated Reinforcement Learning Designed for Brain Machine Interface.

Enhancing EEG Signal Generation through a Hybrid Approach Integrating Reinforcement Learning and Diffusion Models

A Novel End-to-end Network Based on a bidirectional GRU and a Self-Attention Mechanism for Denoising of Electroencephalography Signals

EEGGAN-Net: enhancing EEG signal classification through data augmentation

Attention-Based Parallel Multiscale Convolutional Neural Network for Visual Evoked Potentials EEG Classification.

EEGNet: a compact convolutional neural network for EEG-based brain–computer interfaces

Know Your Mind: Adaptive Brain Signal Classification with Reinforced Attentive Convolutional Neural Networks

A Spiking Neural Network With Adaptive Graph Convolution and LSTM for EEG-Based Brain-Computer Interfaces

Inter-subject transfer learning with an end-to-end deep convolutional neural network for EEG-based BCI

Transformer-based Spatial-Temporal Feature Learning for EEG Decoding

EEG_RL-Net: Enhancing EEG MI Classification through Reinforcement Learning-Optimised Graph Neural Networks

An Attention-based Bi-LSTM Method for Visual Object Classification Via EEG

A Novel Multiscale Dilated Convolution Neural Network with Gating Mechanism for Decoding Driving Intentions Based on EEG

An Intersubject Brain-Computer Interface Based on Domain-Adversarial Training of Convolutional Neural Network for Online Attention Decoding

EEG-based Auditory Attention Detection with Spiking Graph Convolutional Network

A Hierarchical Bidirectional GRU Model With Attention for EEG-Based Emotion Classification

An End-to-end 3D Convolutional Neural Network for Decoding Attentive Mental State.

Multi-Scale Neural Network for EEG Representation Learning in BCI

Predicting Human Intention-Behavior Through EEG Signal Analysis Using Multi-Scale CNN

Single-Channel EEG Classification of Human Attention with Two-Branch Multiscale CNN and Transformer Model