Abstract:The decoding of motor imagery (MI) electroencephalogram (EEG) is an essential component of the brain–computer interface (BCI), which can help patients with motor impairment communicate directly with the outside world through assistive devices. The key to motor imagery electroencephalogram (MI-EEG) classification is to extract multiple temporal, spatial, and spectral features, to obtain more comprehensive and representative information. However, current deep learning methods must fully consider the depth of temporal features and multi-spectral knowledge in EEG and often ignore the temporal or spectrum dependence in MI-EEG. In addition, the lack of effective feature fusion methods can lead to information redundancy, which affects decoding performance. To solve the above problems, this paper proposes a novel MI-EEG decoding method, named multi-scale feature fusion network based on attention mechanism (MSFF-SENet). Firstly, the multi-scale spatio-temporal module (MS-STM) and the multi-scale temporal module (MSTM) extract spatial and high-dimensional temporal features from the original signal. Then, the power spectral density estimation (PSD) convolution module (PSD-Conv module) acquires the multi-spectral features of the MI-EEG signal. Secondly, the feature fusion module fuses spatio-temporal and multi-spectral features to generate integrated feature mappings and establish the dependencies between different features. Finally, we conducted a visual analysis of the results, explaining the neural activity patterns of various motor imagery tasks in different frequency ranges and revealing the potential relationship between body movement and changes related to brain activity. The experimental results show that the classification accuracy of this model in BCI Competition IV 2a (BCI IV 2a) and High Gamma (HGD) datasets is 85.37% and 96.60%, respectively, which is superior to the most advanced methods.

A Novel Feature Fusion Approach for Classification of Motor Imagery EEG Based on Hierarchical Extreme Learning Machine

Motor Imagery EEG Signal Classification Using Distinctive Feature Fusion with Adaptive Structural LASSO

Motor Imagery EEG Classification Based on Kernel Hierarchical Extreme Learning Machine.

Two-level multi-domain feature extraction on sparse representation for motor imagery classification

Classification Based on Multilayer Extreme Learning Machine for Motor Imagery Task from EEG Signals

Densely Feature Fusion Based On Convolutional Neural Networks For Motor Imagery Eeg Classification

Sparse Representation-Based Extreme Learning Machine for Motor Imagery EEG Classification

Efficient Feature Learning Model of Motor Imagery EEG Signals with L1-Norm and Weighted Fusion

Feature Extraction Of Motor Imagery Eeg Based On Extreme Learning Machine Auto-Encoder

A Novel Deep Learning Approach with Data Augmentation to Classify Motor Imagery Signals

Motor imagery EEG classification algorithm based on CNN-LSTM feature fusion network

An improved feature extraction method using low-rank representation for motor imagery classification

A hierarchical semi-supervised extreme learning machine method for EEG recognition

Motor intent recognition of multi-feature fusion EEG signals by UMAP algorithm

A Multi-Domain Feature Extraction Method with Improved LMD

Deep Spatial-Temporal Neural Network for Classification of EEG-Based Motor Imagery

A novel recognition and classification approach for motor imagery based on spatio-temporal features

Recognition of EEG Signal Motor Imagery Intention Based on Deep Multi-View Feature Learning.

A Deep Learning Method For Classification Of Eeg Data Based On Motor Imagery

Motor Imagery EEG Classification Algorithm Based on Improved Lightweight Feature Fusion Network

A Multiscale Feature Fusion Network Based on Attention Mechanism for Motor Imagery EEG Decoding