Abstract:Motor imagery, one of the main brain-computer interface (BCI) paradigms, has been extensively utilized in numerous BCI applications, such as the interaction between disabled people and external devices. Precise decoding, one of the most significant aspects of realizing efficient and stable interaction, has received a great deal of intensive research. However, the current decoding methods based on deep learning are still dominated by single-scale serial convolution, which leads to insufficient extraction of abundant information from motor imagery signals. To overcome such challenges, we propose a new end-to-end convolutional neural network based on multiscale spatial-temporal feature fusion (MSTFNet) for EEG classification of motor imagery. The architecture of MSTFNet consists of four distinct modules: feature enhancement module, multiscale temporal feature extraction module, spatial feature extraction module and feature fusion module, with the latter being further divided into the depthwise separable convolution block and efficient channel attention block. Moreover, we implement a straightforward yet potent data augmentation strategy to bolster the performance of MSTFNet significantly. To validate the performance of MSTFNet, we conduct cross-session experiments and leave-one-subject-out experiments. The cross-session experiment is conducted across two public datasets and one laboratory dataset. On the public datasets of BCI Competition IV 2a and BCI Competition IV 2b, MSTFNet achieves classification accuracies of 83.62% and 89.26%, respectively. On the laboratory dataset, MSTFNet achieves 86.68% classification accuracy. Besides, the leave-one-subject-out experiment is performed on the BCI Competition IV 2a dataset, and MSTFNet achieves 66.31% classification accuracy. These experimental results outperform several state-of-the-art methodologies, indicate the proposed MSTFNet's robust capability in decoding EEG signals associated with motor imagery.

Deep Learning of Multifractal Attributes from Motor Imagery Induced EEG.

Classification of Motor Imagery Signals Using Noise-Assisted Fast Multivariate Empirical Mode Decomposition

A Frequency-Temporal-spatial Method for Motor-Related Electroencephalography Pattern Recognition by Comprehensive Feature Optimization

Fractal Dimension as a discriminative feature for high accuracy classification in motor imagery EEG-based brain-computer interface

Deep-learning-based motor imagery EEG classification by exploiting the functional connectivity of cortical source imaging

A novel recognition and classification approach for motor imagery based on spatio-temporal features

Motor Imagery EEG Signal Classification Using Distinctive Feature Fusion with Adaptive Structural LASSO

Motor Imagery Classification Emphasizing Corresponding Frequency Domain Method based on Deep Learning Framework

A Dynamic Domain Adaptation Deep Learning Network for EEG-based Motor Imagery Classification

3D Convolution neural network with multiscale spatial and temporal cues for motor imagery EEG classification

Multiscale Spatial-Temporal Feature Fusion Neural Network for Motor Imagery Brain-Computer Interfaces

Electroencephalogram-Based Motor Imagery Classification Using Deep Residual Convolutional Networks

An improved feature extraction method using low-rank representation for motor imagery classification

A novel multi-branch hybrid neural network for motor imagery EEG signal classification

Optimal Deep Learning-Based Recognition Model for EEG Enabled Brain-Computer Interfaces Using Motor-Imagery

A Multifrequency Brain Network-Based Deep Learning Framework for Motor Imagery Decoding

Multi-Scale Convolutional Attention and Riemannian Geometry Network for EEG-Based Motor Imagery Classification

Short time Fourier transformation and deep neural networks for motor imagery brain computer interface recognition.

An in-depth survey on Deep Learning-based Motor Imagery Electroencephalogram (EEG) classification

A diagonal masking self-attention-based multi-scale network for motor imagery classification

Time-space-frequency feature Fusion for 3-channel motor imagery classification