Abstract:Electroencephalography (EEG)-based brain-computer interfaces (BCIs) pose a challenge for decoding due to their low spatial resolution and signal-to-noise ratio. Typically, EEG-based recognition of activities and states involves the use of prior neuroscience knowledge to generate quantitative EEG features, which may limit BCI performance. Although neural network-based methods can effectively extract features, they often encounter issues such as poor generalization across datasets, high predicting volatility, and low model interpretability. To address these limitations, we propose a novel lightweight multi-dimensional attention network, called LMDA-Net. By incorporating two novel attention modules designed specifically for EEG signals, the channel attention module and the depth attention module, LMDA-Net is able to effectively integrate features from multiple dimensions, resulting in improved classification performance across various BCI tasks. LMDA-Net was evaluated on four high-impact public datasets, including motor imagery (MI) and P300-Speller, and was compared with other representative models. The experimental results demonstrate that LMDA-Net outperforms other representative methods in terms of classification accuracy and predicting volatility, achieving the highest accuracy in all datasets within 300 training epochs. Ablation experiments further confirm the effectiveness of the channel attention module and the depth attention module. To facilitate an in-depth understanding of the features extracted by LMDA-Net, we propose class-specific neural network feature interpretability algorithms that are suitable for evoked responses and endogenous activities. By mapping the output of the specific layer of LMDA-Net to the time or spatial domain through class activation maps, the resulting feature visualizations can provide interpretable analysis and establish connections with EEG time-spatial analysis in neuroscience. In summary, LMDA-Net shows great potential as a general decoding model for various EEG tasks.

An End-to-end 3D Convolutional Neural Network for Decoding Attentive Mental State.

Deep Learning Decoding of Mental State in Non-invasive Brain Computer Interface

Attention module improves both performance and interpretability of four‐dimensional functional magnetic resonance imaging decoding neural network

Attention module improves both performance and interpretability of 4D fMRI decoding neural network

Inter-subject transfer learning with an end-to-end deep convolutional neural network for EEG-based BCI

LMDA-Net:A lightweight multi-dimensional attention network for general EEG-based brain-computer interfaces and interpretability

SADNet: Sustained Attention Decoding in a Driving Task by Self-Attention Convolutional Neural Network

LMDA-Net:A lightweight multi-dimensional attention network for general EEG-based brain-computer interface paradigms and interpretability

Positional-Spectral-Temporal Attention in 3D Convolutional Neural Networks for EEG Emotion Recognition

3DCANN: A Spatio-Temporal Convolution Attention Neural Network for EEG Emotion Recognition

4D attention-based neural network for EEG emotion recognition

A Robust 3D-Convolutional Neural Network-Based Electroencephalogram Decoding Model for the Intra-Individual Difference

The Abnormal Detection of Electroencephalogram With Three-Dimensional Deep Convolutional Neural Networks

An Intersubject Brain-Computer Interface Based on Domain-Adversarial Training of Convolutional Neural Network for Online Attention Decoding

Know Your Mind: Adaptive Brain Signal Classification with Reinforced Attentive Convolutional Neural Networks

MAtt: A Manifold Attention Network for EEG Decoding

Attention-based 3D Convolutional Network for Alzheimer's Disease Diagnosis and Biomarkers Exploration

3D Convolution neural network with multiscale spatial and temporal cues for motor imagery EEG classification

Decoding Subject-Driven Cognitive States from EEG Signals for Cognitive Brain–Computer Interface

Auditory Attention Decoding from EEG Using Convolutional Recurrent Neural Network

Attend and Decode: 4D fMRI Task State Decoding Using Attention Models