Abstract:Objective. Motor-imagery (MI) classification base on electroencephalography (EEG) has been long studied in neuroscience and more recently widely used in healthcare applications such as mobile assistive robots and neurorehabilitation. In particular, EEG-based MI classification methods that rely on convolutional neural networks (CNNs) have achieved relatively high classification accuracy. However, naively training CNNs to classify raw EEG data from all channels, especially for high-density EEG, is computationally demanding and requires huge training sets. It often also introduces many irrelevant input features, making it difficult for the CNN to extract the informative ones. This problem is compounded by a dearth of training data, which is particularly acute for MI tasks, because these are cognitively demanding and thus fatigue inducing. Approach. To address these issues, we proposed an end-to-end CNN-based neural network with attentional mechanism together with different data augmentation (DA) techniques. We tested it on two benchmark MI datasets, brain–computer interface (BCI) competition IV 2a and 2b. In addition, we collected a new dataset, recorded using high-density EEG, and containing both MI and motor execution (ME) tasks, which we share with the community. Main results. Our proposed neural-network architecture outperformed all state-of-the-art methods that we found in the literature, with and without DA, reaching an average classification accuracy of 93.6% and 87.83% on BCI 2a and 2b, respectively. We also directly compare decoding of MI and ME tasks. Focusing on MI classification, we find optimal channel configurations and the best DA techniques as well as investigate combining data across participants and the role of transfer learning. Significance. Our proposed approach improves the classification accuracy for MI in the benchmark datasets. In addition, collecting our own dataset enables us to compare MI and ME and investigate various aspects of EEG decoding critical for neuroscience and BCI.

CS-Net: an End-to-end Network for Motor Imagery Brain-Machine Interface with Adaptive Channel Selection and Compressed Sensing

Constructing Lightweight and Efficient Spiking Neural Networks for EEG-based Motor Imagery Classification

MI-BMInet: An Efficient Convolutional Neural Network for Motor Imagery Brain--Machine Interfaces with EEG Channel Selection

MI-BMInet: An Efficient Convolutional Neural Network for Motor Imagery Brain–Machine Interfaces With EEG Channel Selection

FBMSNet: A Filter-Bank Multi-Scale Convolutional Neural Network for EEG-Based Motor Imagery Decoding

ETCNet: An EEG-based motor imagery classification model combining efficient channel attention and temporal convolutional network

A new attention-based 3D densely connected cross-stage-partial network for motor imagery classification in BCI

Motor Imagery Classification Based on Deep Convolutional Neural Network and Its Application in Exoskeleton Controlled by EEG

Multilayer network-based channel selection for motor imagery brain-computer interface

Motor imagery recognition with automatic EEG channel selection and deep learning

Dual-Branch Convolution Network With Efficient Channel Attention for EEG-Based Motor Imagery Classification

MACNet: A Multidimensional Attention-Based Convolutional Neural Network for Lower-Limb Motor Imagery Classification

TMSA-Net:A novel attention mechanism for improved motor imagery EEG signal processing

A diagonal masking self-attention-based multi-scale network for motor imagery classification

SincMSNet: A Sinc filter convolutional neural network for EEG motor imagery classification

Physics-Informed Attention Temporal Convolutional Network for EEG-Based Motor Imagery Classification

A Spatial-Spectral and Temporal Dual Prototype Network for Motor Imagery Brain-Computer Interface

Multiscale Spatial-Temporal Feature Fusion Neural Network for Motor Imagery Brain-Computer Interfaces

TCACNet: Temporal and channel attention convolutional network for motor imagery classification of EEG-based BCI

An end-to-end CNN with attentional mechanism applied to raw EEG in a BCI classification task

An Accurate EEGNet-based Motor-Imagery Brain-Computer Interface for Low-Power Edge Computing