Unsupervised Multi-Source Variational Domain Adaptation for Inter-Subject SSVEP-based BCIs

Shubin Zhang,Dong An,Jincun Liu,Yaoguang Wei,Fuchun Sun
DOI: https://doi.org/10.1016/j.eswa.2023.122155
IF: 8.5
2024-01-01
Expert Systems with Applications
Abstract:Steady-State Visual Evoked Potential-based Brain–Computer Interfaces (SSVEP-based BCIs) are widely used to decode electroencephalography (EEG) data, often employing subject-specific models. However, these methods demand a substantial volume of labeled data, which tends to induce visual fatigue in subjects. To address this challenge, an efficient approach is to transfer known subject knowledge through inter-subject methods using unlabeled data. However, the previous state-of-the-art unsupervised inter-subject model is limited by the feature extraction capability of spatial filter methods. To overcome this limitation, we propose a novel Multi-source Variational Domain Adaptation (MVDA) method, which incorporates a Filter-bank Dynamic Graph Convolutional Network (FBDGCN). The FBDGCN aims to extract distinctive graph features under different harmonics from offline labeled source and unlabeled target EEG data. Subsequently, the source and target graph features are jointly trained using MVDA for domain adaptation. With proposed variational inference mechanism, MVDA can constrain the distribution manifold and minimize the domain discrepancy. Since the performance of knowledge transfer heavily relies on the similarity between source and target domains, we also propose an unsupervised subject correlation analysis method to select the source subjects from the dataset. Our experimental results demonstrate that the MVDA method yields a higher information transfer rate (ITR) (189.87 ± 24.98 bits/min) and mean accuracy (92.11 ± 2.85%). The proposed model can be calibrated only by unlabeled target subject data to obtain a higher recognition accuracy, which is more applicable to real-world scenarios.
What problem does this paper attempt to address?