Abstract:Motor imagery, one of the main brain-computer interface (BCI) paradigms, has been extensively utilized in numerous BCI applications, such as the interaction between disabled people and external devices. Precise decoding, one of the most significant aspects of realizing efficient and stable interaction, has received a great deal of intensive research. However, the current decoding methods based on deep learning are still dominated by single-scale serial convolution, which leads to insufficient extraction of abundant information from motor imagery signals. To overcome such challenges, we propose a new end-to-end convolutional neural network based on multiscale spatial-temporal feature fusion (MSTFNet) for EEG classification of motor imagery. The architecture of MSTFNet consists of four distinct modules: feature enhancement module, multiscale temporal feature extraction module, spatial feature extraction module and feature fusion module, with the latter being further divided into the depthwise separable convolution block and efficient channel attention block. Moreover, we implement a straightforward yet potent data augmentation strategy to bolster the performance of MSTFNet significantly. To validate the performance of MSTFNet, we conduct cross-session experiments and leave-one-subject-out experiments. The cross-session experiment is conducted across two public datasets and one laboratory dataset. On the public datasets of BCI Competition IV 2a and BCI Competition IV 2b, MSTFNet achieves classification accuracies of 83.62% and 89.26%, respectively. On the laboratory dataset, MSTFNet achieves 86.68% classification accuracy. Besides, the leave-one-subject-out experiment is performed on the BCI Competition IV 2a dataset, and MSTFNet achieves 66.31% classification accuracy. These experimental results outperform several state-of-the-art methodologies, indicate the proposed MSTFNet's robust capability in decoding EEG signals associated with motor imagery.

MFRC-Net: Multi-Scale Feature Residual Convolutional Neural Network for Motor Imagery Decoding

A Multi-Domain Convolutional Neural Network for EEG-Based Motor Imagery Decoding

MSHANet: a multi-scale residual network with hybrid attention for motor imagery EEG decoding

Multiscale Spatial-Temporal Feature Fusion Neural Network for Motor Imagery Brain-Computer Interfaces

M-FANet: Multi-Feature Attention Convolutional Neural Network for Motor Imagery Decoding

A Multifrequency Brain Network-Based Deep Learning Framework for Motor Imagery Decoding

FBMSNet: A Filter-Bank Multi-Scale Convolutional Neural Network for EEG-Based Motor Imagery Decoding

A Temporal-Spectral-Based Squeeze-and- Excitation Feature Fusion Network for Motor Imagery EEG Decoding

IFNet: An Interactive Frequency Convolutional Neural Network for Enhancing Motor Imagery Decoding From EEG

A coarse-to-fine adaptive spatial–temporal graph convolution network with residuals for motor imagery decoding from the same limb

EEG-FMCNN: A fusion multi-branch 1D convolutional neural network for EEG-based motor imagery classification

A parallel multi-scale time-frequency block convolutional neural network based on channel attention module for motor imagery classification

A robust multi-branch multi-attention-mechanism EEGNet for motor imagery BCI decoding

Efficient Multi-View Graph Convolutional Network with Self-Attention for Multi-Class Motor Imagery Decoding

A Novel Motor Imagery EEG Decoding Method Based on Feature Separation

A channel-mixing convolutional neural network for motor imagery EEG decoding and feature visualization

Attention-based convolutional neural network with multi-modal temporal information fusion for motor imagery EEG decoding

ETCNet: An EEG-based motor imagery classification model combining efficient channel attention and temporal convolutional network

A Densely Connected Multi-Branch 3D Convolutional Neural Network for Motor Imagery EEG Decoding

MSVTNet: Multi-Scale Vision Transformer Neural Network for EEG-Based Motor Imagery Decoding

Manifold Attention-Enhanced Multi-Domain Convolutional Network for Decoding Motor Imagery Intention