Structure invariance-driven collaborative contrastive network for EEG decoding

Shuang Liang,Zengguang Li,Wenlong Hang,Yuanpeng Zhang,Baiying Lei,Jing Qin,Yu Zhang,Kup-Sze Choi
DOI: https://doi.org/10.1016/j.bspc.2023.105214
IF: 5.1
2023-07-02
Biomedical Signal Processing and Control
Abstract:With a large amount of augmented training data generated by data augmentation (DA) methods, deep neural networks (DNN) have achieved promising performance in decoding electroencephalogram (EEG) neural patterns for brain-computer interface (BCI). However, most current methods neglect the data-structure information available in different views of augmented EEG datasets. In particular, the invariance of data-structure information can improve model generalization ability but unexploited. In this paper, we develop the novel Structure Invariance-driven Collaborative Contrastive Network (SICCNet) for EEG recognition. It is a framework with both implicit and explicit constraints to exploit invariant data-structure information. SICCNet contains two structure-guided contrastive learning subnets to perform collaborative contrasts between pairs of normalized embeddings derived from different augmented views. First, implicit constraint is introduced with the Inter-Segment Mixup-based (InSegMix) EEG data augmentation strategy to generate new EEG views without introducing extra noise. Explicit constraint is then introduced through the collaborative contrastive (co-contrastive) regularization scheme to exploit the invariant data-structure information from multiple views. The scheme can direct the model to focus on the invariant data-structure information and consequently enhance the discrimination ability of the model. Extensive experiments on three public motor-imagery (MI) based EEG datasets have demonstrated the outstanding performance of SICCNet when compared with other state-of-the-art methods, indicating its promising potential in improving BCI system.
engineering, biomedical
What problem does this paper attempt to address?