Manifold Attention-Enhanced Multi-Domain Convolutional Network for Decoding Motor Imagery Intention

Bin Lu,Xiaodong Huang,Junxiang Chen,Rongrong Fu,Guilin Wen
DOI: https://doi.org/10.1016/j.knosys.2024.111904
IF: 8.139
2024-05-08
Knowledge-Based Systems
Abstract:Research in brain-computer interface (BCI), particularly in brain intention decoding, has made significant strides relying on the remarkable capabilities of deep learning (DL). However, many current DL framework-based models struggle to effectively utilize complementary information present in various domains of electroencephalographic (EEG) signals. This limitation may lead to suboptimal performance, particularly exacerbated by the presence of noise and artifacts. Therefore, this study proposed a manifold attention-based multi-domain convolutional neural network, known as MAMCNet, to benefit from complementary strengths across different domains of EEG signals. Specifically, the EEG signals were divided into multi-band data representations based on frequency. Multiple spatiotemporal convolutional blocks were then devised to simultaneously extract the spatiotemporal feature maps from these sub-band components. To enhance the model's robustness, these maps were mapped onto the Riemannian manifold. Additionally, manifold attention was utilized to emphasize salient spatiotemporal feature maps with attention focused on the target. A frequency convolutional block was specifically designed to merge optimized feature maps from different bands, extracting temporospatiofrequency features in EEG signals comprehensively. The experimental results on two datasets demonstrated that the proposed model outperformed the mainstream DL architecture-based model. These results suggest that the proposed model could offer an alternative scheme for facilitating BCI applications.
computer science, artificial intelligence
What problem does this paper attempt to address?