Abstract:With the rapid development of deep learning, researchers have gradually applied it to motor imagery brain computer interface (MI-BCI) and initially demonstrated its advantages over traditional machine learning. However, its application still faces many challenges, and the recognition rate of electroencephalogram (EEG) is still the bottleneck restricting the development of MI-BCI. In order to improve the accuracy of EEG classification, a DSC-ConvLSTM model based on the attention mechanism is proposed for the multi-classification of motor imagery EEG signals. To address the problem of the small sample size of well-labeled and accurate EEG data, the preprocessing uses sliding windows for data augmentation, and the average prediction loss of each sliding window is used as the final prediction loss for that trial. This not only increases the training sample size and is beneficial to train complex neural network models, but also the network no longer extracts the global features of the whole trial so as to avoid learning the difference features among trials, which can effectively eliminate the influence of individual specificity. In the aspect of feature extraction and classification, the overall network structure is designed according to the characteristics of the EEG signals in this paper. Firstly, depth separable convolution (DSC) is used to extract spatial features of EEG signals. On the one hand, this reduces the number of parameters and improves the response speed of the system. On the other hand, the network structure we designed is more conducive to extract directly the direct extraction of spatial features of EEG signals. Secondly, the internal structure of the Long Short-Term Memory (LSTM) unit is improved by using convolution and attention mechanism, and a novel bidirectional convolution LSTM (ConvLSTM) structure is proposed by comparing the effects of embedding convolution and attention mechanism in the input and different gates, respectively. In the ConvLSTM module, the convolutional structure is only introduced into the input-to-state transition, while the gates still remain the original fully connected mechanism, and the attention mechanism is introduced into the input to further improve the overall decoding performance of the model. This bidirectional ConvLSTM extracts the time-domain features of EEG signals and integrates the feature extraction capability of the CNN and the sequence processing capability of LSTM. The experimental results show that the average classification accuracy of the model reaches 73.7% and 92.6% on two datasets, BCI Competition IV Dataset 2a and High Gamma Dataset, respectively, which proves the robustness and effectiveness of the model we proposed. It can be seen that the model in this paper can deeply excavate significant EEG features from the original EEG signals, show good performance in different subjects and different datasets, and improve the influence of individual variability on the classification performance, which is of practical significance for promoting the development of brain-computer interface technology towards a practical and marketable direction.

Improving Multi-Class Motor Imagery EEG Classification Using Overlapping Sliding Window and Deep Learning Model

Motor Imagery Classification for Asynchronous EEG-Based Brain–Computer Interfaces

Motor Imagery Classification Emphasizing Corresponding Frequency Domain Method based on Deep Learning Framework

Classification of Motor Imagery Based on Multi-Scale Feature Extraction and the Channel-Temporal Attention Module.

EEG Motor Imagery Classification With Sparse Spectrotemporal Decomposition and Deep Learning

Bidirectional feature pyramid attention-based temporal convolutional network model for motor imagery electroencephalogram classification

A Sliding Window Common Spatial Pattern for Enhancing Motor Imagery Classification in EEG-BCI

Classification of Motor Imagery EEG Signals Based on Data Augmentation and Convolutional Neural Networks

Classification algorithm for EEG-based motor imagery using hybrid neural network with spatio-temporal convolution and multi-head attention mechanism

Multi-class Motor Imagery Classification Method Using One-dimensional Convolutional Neural Networks

Decoding Motor Imagery Tasks Using ESI and Hybrid Feature CNN

A Motor Imagery Signals Classification Method via the Difference of EEG Signals Between Left and Right Hemispheric Electrodes

3D-CLMI: A Motor Imagery EEG Classification Model via Fusion of 3D-CNN and LSTM with Attention

Multiclass classification of motor imagery tasks based on multi-branch convolutional neural network and temporal convolutional network model

EEG Classification of Motor Imagery Using a Novel Deep Learning Framework

Attention-Based DSC-ConvLSTM for Multiclass Motor Imagery Classification

Exploring Feature Selection and Classification Techniques to Improve the Performance of an Electroencephalography-Based Motor Imagery Brain-Computer Interface System

Motor imagery electroencephalogram classification algorithm based on joint features in the spatial and frequency domains and instance transfer

Motor Imagery Classification of Single-Arm Tasks Using Convolutional Neural Network based on Feature Refining

Classification of motor imagery electroencephalogram signals by using adaptive cross-subject transfer learning

Motor Imagery EEG Decoding Based on Multi-scale Hybrid Networks and Feature Enhancement.