Abstract:Motor imagery (MI) brain-computer interface (BCI) assist users in establishing direct communication between their brain and external devices by decoding the movement intention of human electroencephalogram (EEG) signals. However, cerebral cortical potentials are highly rhythmic and sub-band features, different experimental situations and subjects have different categories of semantic information in specific sample target spaces. Feature fusion can lead to more discriminative features, but simple fusion of features from different embedding spaces leading to the model global loss is not easily convergent and ignores the complementarity of features. Considering the similarity and category contribution of different sub-band features, we propose a multi-band centroid contrastive reconstruction fusion network (MB-CCRF). We obtain multi-band spatio-temporal features by frequency division, preserving the task-related rhythmic features of different EEG signals; use a multi-stream cross-layer connected convolutional network to perform a deep feature representation for each sub-band separately; propose a centroid contrastive reconstruction fusion module, which maps different sub-band and category features into the same shared embedding space by comparing with category prototypes, reconstructing the feature semantic structure to ensure that the global loss of the fused features converges more easily. Finally, we use a learning mechanism to model the similarity between channel features and use it as the weight of fused sub-band features, thus enhancing the more discriminative features, suppressing the useless features. The experimental accuracy is 79.96% in the BCI competition Ⅳ-Ⅱa dataset. Moreover, the classification effect of sub-band features of different subjects is verified by comparison tests, the category propensity of different sub-band features is verified by confusion matrix tests and the distribution in different classes of each sub-band feature and fused feature are showed by visual analysis, revealing the importance of different sub-band features for the EEG-based MI classification task.

A Relation Feature Comparison Network for Cross-Domain Recognition of Motion Intention

Exploiting Asymmetric EEG Signals with EFD in Deep Learning Domain for Robust BCI

A Radial Basis Deformable Residual Convolutional Neural Model Embedded with Local Multi-Modal Feature Knowledge and Its Application in Cross-Subject Classification

Prototypical Contrastive Domain Adaptation Network for Nonstationary EEG Classification

A multi-band centroid contrastive reconstruction fusion network for motor imagery electroencephalogram signal decoding

Cross-Channel Specific-Mutual Feature Transfer Learning for Motor Imagery EEG Signals Decoding.

Cross-domain Facial Expression Recognition Via an Intra-Category Common Feature and Inter-Category Distinction Feature Fusion Network

Recognition of EEG-based Movement Intention Combined with Channel Selection Adopting Deep Learning Methods

Cross-Modal Transfer Learning From EEG to Functional Near-Infrared Spectroscopy for Classification Task in Brain-Computer Interface System

A Deep Domain Adaptation Framework with Correlation Alignment for EEG-based Motor Imagery Classification.

Joint Contrastive Learning with Feature Alignment for Cross-Corpus EEG-based Emotion Recognition

Densely Feature Fusion Based On Convolutional Neural Networks For Motor Imagery Eeg Classification

Two-Phase Prototypical Contrastive Domain Generalization for Cross-Subject EEG-Based Emotion Recognition

Distinguishable Spatial-Spectral Feature Learning Neural Network Framework for Motor Imagery-Based Brain–computer Interface

Cascade and Parallel Convolutional Recurrent Neural Networks on EEG-based Intention Recognition for Brain Computer Interface

Cross-Subject Emotion Recognition Brain–Computer Interface Based on fNIRS and DBJNet

Subject Separation Network for Reducing Calibration Time of MI-Based BCI

EEG-FRM: a neural network based familiar and unfamiliar face EEG recognition method

Cross Domain Correlation Maximization for Enhancing the Target Recognition of SSVEP-Based Brain-Computer Interfaces.

Online Multi-level Contrastive Representation Distillation for Cross-Subject fNIRS Emotion Recognition

Domain Adaptive Algorithm Based on Multi-Manifold Embedded Distributed Alignment for Brain-Computer Interfaces