Abstract:Electroencephalography (EEG)-based brain-computer interfaces (BCIs) pose a challenge for decoding due to their low spatial resolution and signal-to-noise ratio. Typically, EEG-based recognition of activities and states involves the use of prior neuroscience knowledge to generate quantitative EEG features, which may limit BCI performance. Although neural network-based methods can effectively extract features, they often encounter issues such as poor generalization across datasets, high predicting volatility, and low model interpretability. To address these limitations, we propose a novel lightweight multi-dimensional attention network, called LMDA-Net. By incorporating two novel attention modules designed specifically for EEG signals, the channel attention module and the depth attention module, LMDA-Net is able to effectively integrate features from multiple dimensions, resulting in improved classification performance across various BCI tasks. LMDA-Net was evaluated on four high-impact public datasets, including motor imagery (MI) and P300-Speller, and was compared with other representative models. The experimental results demonstrate that LMDA-Net outperforms other representative methods in terms of classification accuracy and predicting volatility, achieving the highest accuracy in all datasets within 300 training epochs. Ablation experiments further confirm the effectiveness of the channel attention module and the depth attention module. To facilitate an in-depth understanding of the features extracted by LMDA-Net, we propose class-specific neural network feature interpretability algorithms that are suitable for evoked responses and endogenous activities. By mapping the output of the specific layer of LMDA-Net to the time or spatial domain through class activation maps, the resulting feature visualizations can provide interpretable analysis and establish connections with EEG time-spatial analysis in neuroscience. In summary, LMDA-Net shows great potential as a general decoding model for various EEG tasks.

Deep Learning Decoding of Mental State in Non-invasive Brain Computer Interface

An End-to-end 3D Convolutional Neural Network for Decoding Attentive Mental State.

Exploiting Asymmetric EEG Signals with EFD in Deep Learning Domain for Robust BCI

Enhancing EEG Motor Imagery Decoding Performance Via Deep Temporal-domain Information Extraction

A Hybrid Autoencoder Framework of Dimensionality Reduction for Brain-Computer Interface Decoding

Portable deep-learning decoder for motor imaginary EEG signals based on a novel compact convolutional neural network incorporating spatial-attention mechanism

Decoding human brain activity with deep learning

Continuous Tracking using Deep Learning-based Decoding for Non-invasive Brain-Computer Interface

Speech decoding from stereo-electroencephalography (sEEG) signals using advanced deep learning methods

Deep Learning with Convolutional Neural Networks for Motor Brain-Computer Interfaces Based on Stereo-Electroencephalography (SEEG)

Deep Convolutional Neural Network for EEG-Based Motor Decoding

Continuous tracking using deep learning-based decoding for noninvasive brain-computer interface

A Novel Classification Algorithm for MI-EEG Based on Deep Learning

Learning joint space-time-frequency features for EEG decoding on small labeled data

LMDA-Net:A lightweight multi-dimensional attention network for general EEG-based brain-computer interfaces and interpretability

Du-IN-v2: Unleashing the Power of Vector Quantization for Decoding Cognitive States from Intracranial Neural Signals

Deep Fusion Feature Learning Network for MI-EEG Classification.

Attention module improves both performance and interpretability of four‐dimensional functional magnetic resonance imaging decoding neural network

EEG-based intention recognition with deep recurrent-convolution neural network: Performance and channel selection by Grad-CAM

Inter-subject transfer learning with an end-to-end deep convolutional neural network for EEG-based BCI

An Intersubject Brain-Computer Interface Based on Domain-Adversarial Training of Convolutional Neural Network for Online Attention Decoding