Abstract:Motor imagery (MI) electroencephalography (EEG) classification is an important part of the brain-computer interface (BCI), allowing people with mobility problems to communicate with the outside world via assistive devices. However, EEG decoding is a challenging task because of its complexity, dynamic nature, and low signal-to-noise ratio. Designing an end-to-end framework that fully extracts the high-level features of EEG signals remains a challenge. In this study, we present a parallel spatial–temporal self-attention-based convolutional neural network for four-class MI EEG signal classification. This study is the first to define a new spatial-temporal representation of raw EEG signals that uses the self-attention mechanism to extract distinguishable spatial–temporal features. Specifically, we use the spatial self-attention module to capture the spatial dependencies between the channels of MI EEG signals. This module updates each channel by aggregating features over all channels with a weighted summation, thus improving the classification accuracy and eliminating the artifacts caused by manual channel selection. Furthermore, the temporal self-attention module encodes the global temporal information into features for each sampling time step, so that the high-level temporal features of the MI EEG signals can be extracted in the time domain. Quantitative analysis shows that our method outperforms state-of-the-art methods for intra-subject and inter-subject classification, demonstrating its robustness and effectiveness. In terms of qualitative analysis, we perform a visual inspection of the new spatial–temporal representation estimated from the learned architecture. Finally, the proposed method is employed to realize control of drones based on EEG signal, verifying its feasibility in real-time applications.

A Detective Method for Multi-class EEG-based Motor Imagery Classification Based on OCSVM

Classification of Motor Imagery Signals Using Noise-Assisted Fast Multivariate Empirical Mode Decomposition

Multi-class Motor Imagery Classification Method Using One-dimensional Convolutional Neural Networks

Classification algorithm for EEG-based motor imagery using hybrid neural network with spatio-temporal convolution and multi-head attention mechanism

A Motor Imagery Signals Classification Method via the Difference of EEG Signals Between Left and Right Hemispheric Electrodes

Motor Imagery Classification Based on Deep Convolutional Neural Network and Its Application in Exoskeleton Controlled by EEG

A novel method for classification of multi-class motor imagery tasks based on feature fusion

Multiclass classification of motor imagery tasks based on multi-branch convolutional neural network and temporal convolutional network model

Online BCI systems: cross-subject motor imagery classification based on weighted time-domain feature extraction methods

EEG Classification by Filter Band Component Regularized Common Spatial Pattern for Motor Imagery.

Motor Imagery Classification for Asynchronous EEG-Based Brain–Computer Interfaces

A Compact Multi-Branch 1D Convolutional Neural Network for EEG-based Motor Imagery Classification

A classification method for EEG motor imagery signals based on parallel convolutional neural network

A Cross-Space CNN With Customized Characteristics for Motor Imagery EEG Classification

Convolutional neural network with support vector machine for motor imagery EEG signal classification

Motor imagery electroencephalogram classification algorithm based on joint features in the spatial and frequency domains and instance transfer

Single-trial EEG Classification of Motor Imagery Using Deep Convolutional Neural Networks

Parallel Spatial–Temporal Self-Attention CNN-Based Motor Imagery Classification for BCI

Multi-band spatial feature extraction and classification for motor imaging EEG signals based on OSFBCSP-GAO-SVM model : EEG signal processing

Decoding Multi-Class EEG Signals of Hand Movement Using Multivariate Empirical Mode Decomposition and Convolutional Neural Network

A CSP\AM-BA-SVM Approach for Motor Imagery BCI System