Abstract:Motor imagery (MI) brain-computer interface (BCI) assist users in establishing direct communication between their brain and external devices by decoding the movement intention of human electroencephalogram (EEG) signals. However, cerebral cortical potentials are highly rhythmic and sub-band features, different experimental situations and subjects have different categories of semantic information in specific sample target spaces. Feature fusion can lead to more discriminative features, but simple fusion of features from different embedding spaces leading to the model global loss is not easily convergent and ignores the complementarity of features. Considering the similarity and category contribution of different sub-band features, we propose a multi-band centroid contrastive reconstruction fusion network (MB-CCRF). We obtain multi-band spatio-temporal features by frequency division, preserving the task-related rhythmic features of different EEG signals; use a multi-stream cross-layer connected convolutional network to perform a deep feature representation for each sub-band separately; propose a centroid contrastive reconstruction fusion module, which maps different sub-band and category features into the same shared embedding space by comparing with category prototypes, reconstructing the feature semantic structure to ensure that the global loss of the fused features converges more easily. Finally, we use a learning mechanism to model the similarity between channel features and use it as the weight of fused sub-band features, thus enhancing the more discriminative features, suppressing the useless features. The experimental accuracy is 79.96% in the BCI competition Ⅳ-Ⅱa dataset. Moreover, the classification effect of sub-band features of different subjects is verified by comparison tests, the category propensity of different sub-band features is verified by confusion matrix tests and the distribution in different classes of each sub-band feature and fused feature are showed by visual analysis, revealing the importance of different sub-band features for the EEG-based MI classification task.

EEG-FMCNN: A fusion multi-branch 1D convolutional neural network for EEG-based motor imagery classification

One-Dimensional Convolutional Multi-branch Fusion Network for EEG-Based Motor Imagery Classification

A Compact Multi-Branch 1D Convolutional Neural Network for EEG-based Motor Imagery Classification

An end-to-end multi-task motor imagery EEG classification neural network based on dynamic fusion of spectral-temporal features

FBMSNet: A Filter-Bank Multi-Scale Convolutional Neural Network for EEG-Based Motor Imagery Decoding

MI-MBFT: Superior Motor Imagery Decoding of Raw EEG Data Based on a Multi-Branch and Fusion Transformer Framework

A Multi-Domain Convolutional Neural Network for EEG-Based Motor Imagery Decoding

Recognition of single upper limb motor imagery tasks from EEG using multi-branch fusion convolutional neural network

ETCNet: An EEG-based motor imagery classification model combining efficient channel attention and temporal convolutional network

Multiscale Spatial-Temporal Feature Fusion Neural Network for Motor Imagery Brain-Computer Interfaces

Multiclass classification of motor imagery tasks based on multi-branch convolutional neural network and temporal convolutional network model

Motor Imagery Classification Based on Deep Convolutional Neural Network and Its Application in Exoskeleton Controlled by EEG

A novel multi-branch hybrid neural network for motor imagery EEG signal classification

EISATC-Fusion: Inception Self-Attention Temporal Convolutional Network Fusion for Motor Imagery EEG Decoding

A parallel multi-scale time-frequency block convolutional neural network based on channel attention module for motor imagery classification

A Densely Connected Multi-Branch 3D Convolutional Neural Network for Motor Imagery EEG Decoding

A multi-band centroid contrastive reconstruction fusion network for motor imagery electroencephalogram signal decoding

A Parallel Multiscale Filter Bank Convolutional Neural Networks for Motor Imagery EEG Classification

Multiscale space-time-frequency feature-guided multitask learning CNN for motor imagery EEG classification

EEG Motor Imagery Classification With Sparse Spectrotemporal Decomposition and Deep Learning

3D Convolution neural network with multiscale spatial and temporal cues for motor imagery EEG classification