Abstract:Motor imagery, one of the main brain-computer interface (BCI) paradigms, has been extensively utilized in numerous BCI applications, such as the interaction between disabled people and external devices. Precise decoding, one of the most significant aspects of realizing efficient and stable interaction, has received a great deal of intensive research. However, the current decoding methods based on deep learning are still dominated by single-scale serial convolution, which leads to insufficient extraction of abundant information from motor imagery signals. To overcome such challenges, we propose a new end-to-end convolutional neural network based on multiscale spatial-temporal feature fusion (MSTFNet) for EEG classification of motor imagery. The architecture of MSTFNet consists of four distinct modules: feature enhancement module, multiscale temporal feature extraction module, spatial feature extraction module and feature fusion module, with the latter being further divided into the depthwise separable convolution block and efficient channel attention block. Moreover, we implement a straightforward yet potent data augmentation strategy to bolster the performance of MSTFNet significantly. To validate the performance of MSTFNet, we conduct cross-session experiments and leave-one-subject-out experiments. The cross-session experiment is conducted across two public datasets and one laboratory dataset. On the public datasets of BCI Competition IV 2a and BCI Competition IV 2b, MSTFNet achieves classification accuracies of 83.62% and 89.26%, respectively. On the laboratory dataset, MSTFNet achieves 86.68% classification accuracy. Besides, the leave-one-subject-out experiment is performed on the BCI Competition IV 2a dataset, and MSTFNet achieves 66.31% classification accuracy. These experimental results outperform several state-of-the-art methodologies, indicate the proposed MSTFNet's robust capability in decoding EEG signals associated with motor imagery.

Enhancing Motor Imagery Classification with Residual Graph Convolutional Networks and Multi-Feature Fusion

MST-DGCN: A Multi-Scale Spatio-Temporal and Dynamic Graph Convolution Fusion Network for Electroencephalogram Recognition of Motor Imagery

Time-Frequency-Space EEG Decoding Model Based on Dense Graph Convolutional Network for Stroke

Motor Imagery EEG Decoding Based on Multi-scale Hybrid Networks and Feature Enhancement.

Attention-Based Multi-dimensional Feature Graph Convolutional Network for Motor Imagery Classification

Multiscale Spatial-Temporal Feature Fusion Neural Network for Motor Imagery Brain-Computer Interfaces

A brain topography graph embedded convolutional neural network for EEG-based motor imagery classification

Graph neural network based on brain inspired forward-forward mechanism for motor imagery classification in brain-computer interfaces

EEG Decoding Method Based on Multi-Feature Information Fusion for Spinal Cord Injury

Motor Imagery EEG Classification with Self-attention-based Convolutional Neural Network

A Multiscale Feature Fusion Network Based on Attention Mechanism for Motor Imagery EEG Decoding

Efficient Multi-View Graph Convolutional Network with Self-Attention for Multi-Class Motor Imagery Decoding

Self-attention-based Convolutional Neural Network AND Time-frequency Common Spatial Pattern for enhanced Motor Imagery Classification

MI-MBFT: Superior Motor Imagery Decoding of Raw EEG Data Based on a Multi-Branch and Fusion Transformer Framework

Enhancement of Time-Frequency Energy for the Classification of Motor Imagery Electroencephalogram Based on an Improved FitzHugh–Nagumo Neuron System

Integrating Electroencephalography Source Localization and Residual Convolutional Neural Network for Advanced Stroke Rehabilitation

Motor Imagery EEG Recognition Based on an Improved Convolutional Neural Network with Parallel Gate Recurrent Unit.

One-Dimensional Convolutional Multi-branch Fusion Network for EEG-Based Motor Imagery Classification

A Mutli-Scale Spatial-Temporal Convolutional Neural Network with Contrastive Learning for Motor Imagery EEG Classification

EEG-FMCNN: A fusion multi-branch 1D convolutional neural network for EEG-based motor imagery classification

Multiclass classification of motor imagery tasks based on multi-branch convolutional neural network and temporal convolutional network model