Abstract:The brain computer interface (BCI) is a nonstimulatory direct and occasionally bidirectional communication link between the brain and a computer or an external device. Classically, EEG-based BCI algorithms have relied on models such as support vector machines and linear discriminant analysis or multiclass common spatial patterns. During the last decade, however, more sophisticated machine learning architectures, such as convolutional neural networks, recurrent neural networks, long short-term memory networks and gated recurrent unit networks, have been extensively used to enhance discriminability in multiclass BCI tasks. Additionally, preprocessing and denoising of EEG signals has always been key in the successful decoding of brain activity, and the determination of an optimal and standardized EEG preprocessing activity is an active area of research. In this paper, we present a deep neural network architecture specifically engineered to a) provide state-of-the-art performance in multiclass motor imagery classification and b) remain robust to preprocessing to enable real-time processing of raw data as it streams from EEG and BCI equipment. It is based on the intertwined use of time-distributed fully connected (tdFC) and space-distributed 1D temporal convolutional layers (sdConv) and explicitly addresses the possibility that interaction of spatial and temporal features of the EEG signal occurs at all levels of complexity. Numerical experiments demonstrate that our architecture provides superior performance compared baselines based on a combination of 3D convolutions and recurrent neural networks in a six-class motor imagery network, with a subjectwise accuracy that reaches 99%. Importantly, these results remain unchanged when minimal or extensive preprocessing is applied, possibly paving the way for a more transversal and real-time use of deep learning architectures in EEG classification.

Deep learning for hybrid EEG-fNIRS brain–computer interface: application to motor imagery classification

Integrating EEG and NIRS Improves BCI Performance During Motor Imagery

Exploiting Asymmetric EEG Signals with EFD in Deep Learning Domain for Robust BCI

Motor Imagery Decoding Enhancement Based on Hybrid EEG-fNIRS Signals

An intertwined neural network model for EEG classification in brain-computer interfaces

A simplified hybrid EEG-fNIRS Brain-Computer Interface for motor task classification

Enhanced performance by a hybrid NIRS–EEG brain computer interface

A Deep Learning Method For Classification Of Eeg Data Based On Motor Imagery

A Hybrid EEG-fNIRS Brain-Computer Interface Based on Dynamic Functional Connectivity and Long Short-Term Memory

Classification algorithm for motor imagery fusing CNN and attentional mechanisms based on functional near-infrared spectroscopy brain image

Improved Classification Performance of EEG-fNIRS Multimodal Brain-Computer Interface Based on Multi-Domain Features and Multi-Level Progressive Learning

A novel deep learning approach for classification of EEG motor imagery signals

A Motor Imagery Signals Classification Method via the Difference of EEG Signals Between Left and Right Hemispheric Electrodes

An end-to-end multi-task motor imagery EEG classification neural network based on dynamic fusion of spectral-temporal features

CNN-based classification of fNIRS signals in motor imagery BCI system

A 1D CNN for high accuracy classification and transfer learning in motor imagery EEG-based brain-computer interface

A Hybrid Deep Learning Framework Using Scaling‐Basis Chirplet Transform for Motor Imagery EEG Recognition in Brain–Computer Interface Applications

An in-depth survey on Deep Learning-based Motor Imagery Electroencephalogram (EEG) classification

A Hybrid Brain-Computer Interface Combining the EEG and NIRS

Visual Motion Imagery Classification with Deep Neural Network based on Functional Connectivity

EEG-based motor imagery channel selection and classification using hybrid optimization and two-tier deep learning