Abstract:Introduction: As an interactive method gaining popularity, brain-computer interfaces (BCIs) aim to facilitate communication between the brain and external devices. Among the various research topics in BCIs, the classification of motor imagery using electroencephalography (EEG) signals has the potential to greatly improve the quality of life for people with disabilities. Methods: This technology assists them in controlling computers or other devices like prosthetic limbs, wheelchairs, and drones. However, the current performance of EEG signal decoding is not sufficient for real-world applications based on Motor Imagery EEG (MI-EEG). To address this issue, this study proposes an attention-based bidirectional feature pyramid temporal convolutional network model for the classification task of MI-EEG. The model incorporates a multi-head self-attention mechanism to weigh significant features in the MI-EEG signals. It also utilizes a temporal convolution network (TCN) to separate high-level temporal features. The signals are enhanced using the sliding-window technique, and channel and time-domain information of the MI-EEG signals is extracted through convolution. Results: Additionally, a bidirectional feature pyramid structure is employed to implement attention mechanisms across different scales and multiple frequency bands of the MI-EEG signals. The performance of our model is evaluated on the BCI Competition IV-2a dataset and the BCI Competition IV-2b dataset, and the results showed that our model outperformed the state-of-the-art baseline model, with an accuracy of 87.5 and 86.3% for the subject-dependent, respectively. Discussion: In conclusion, the BFATCNet model offers a novel approach for EEG-based motor imagery classification in BCIs, effectively capturing relevant features through attention mechanisms and temporal convolutional networks. Its superior performance on the BCI Competition IV-2a and IV-2b datasets highlights its potential for real-world applications. However, its performance on other datasets may vary, necessitating further research on data augmentation techniques and integration with multiple modalities to enhance interpretability and generalization. Additionally, reducing computational complexity for real-time applications is an important area for future work.

Classification algorithm for motor imagery fusing CNN and attentional mechanisms based on functional near-infrared spectroscopy brain image

Classification of Motor Imagery Signals Using Noise-Assisted Fast Multivariate Empirical Mode Decomposition

CNN-based classification of fNIRS signals in motor imagery BCI system

Motor Imagery Decoding Enhancement Based on Hybrid EEG-fNIRS Signals

Motor imagery EEG classification algorithm based on CNN-LSTM feature fusion network

A Stimulus-Independent Hybrid BCI Based on Motor Imagery and Somatosensory Attentional Orientation

Classification Algorithm for fNIRS-based Brain Signals Using Convolutional Neural Network with Spatiotemporal Feature Extraction Mechanism

Parallel Spatial–Temporal Self-Attention CNN-Based Motor Imagery Classification for BCI

Classification algorithm for EEG-based motor imagery using hybrid neural network with spatio-temporal convolution and multi-head attention mechanism

Motor Imagery Classification Based on Deep Convolutional Neural Network and Its Application in Exoskeleton Controlled by EEG

A novel method for classification of multi-class motor imagery tasks based on feature fusion

A bimodal deep learning network based on CNN for fine motor imagery

Self-attention-based Convolutional Neural Network AND Time-frequency Common Spatial Pattern for enhanced Motor Imagery Classification

A Motor Imagery Signals Classification Method via the Difference of EEG Signals Between Left and Right Hemispheric Electrodes

Deep learning for hybrid EEG-fNIRS brain–computer interface: application to motor imagery classification

Application of a Common Spatial Pattern-Based Algorithm for an Fnirs-Based Motor Imagery Brain-Computer Interface.

Bidirectional feature pyramid attention-based temporal convolutional network model for motor imagery electroencephalogram classification

A Hybrid EEG-fNIRS Brain-Computer Interface Based on Dynamic Functional Connectivity and Long Short-Term Memory

Decoding Motor Imagery Tasks Using ESI and Hybrid Feature CNN

Multiscale space-time-frequency feature-guided multitask learning CNN for motor imagery EEG classification

Multiclass classification of motor imagery tasks based on multi-branch convolutional neural network and temporal convolutional network model