Abstract:Electroencephalography (EEG), a medical imaging technique that captures scalp electrical activity of brain structures via electrodes, has been widely used in affective computing. The spatial domain of EEG is rich in affective information. However, few of the existing studies have simultaneously analyzed EEG signals from multiple perspectives of geometric and anatomical structures in spatial domain. In this paper, we propose a multi-view Graph Transformer (MVGT) based on spatial relations, which integrates information from the temporal, frequency and spatial domains, including geometric and anatomical structures, so as to enhance the expressive power of the model comprehensively. We incorporate the spatial information of EEG channels into the model as encoding, thereby improving its ability to perceive the spatial structure of the channels. Meanwhile, experimental results based on publicly available datasets demonstrate that our proposed model outperforms state-of-the-art methods in recent years. In addition, the results also show that the MVGT could extract information from multiple domains and capture inter-channel relationships in EEG emotion recognition tasks effectively.
What problem does this paper attempt to address?
The problem that this paper attempts to solve is: Most of the existing EEG emotion recognition studies have failed to analyze the spatial information of EEG signals from the perspectives of geometry and anatomical structure simultaneously. To address this problem, the author proposes a Multi - view Graph Transformer (MVGT) based on spatial relationships, aiming to integrate information in the time, frequency, and spatial domains, including geometry and anatomical structure, to enhance the expressive ability of the model and improve the accuracy of EEG emotion recognition.
### Specific Problems and Solutions
1. **Limitations of Existing Methods**:
- Existing methods mainly focus on the extraction of features in the time domain, frequency domain, or space - time domain, but pay less attention to the spatial structure information of EEG signals.
- Most methods rely on traditional Graph Neural Networks (GNNs), which may limit their expressive ability due to problems such as over - smoothing, under - reaching, and over - squashing.
2. **Innovations of the MVGT Model**:
- **Multi - view Fusion**: MVGT combines information in the time, frequency, and spatial domains, and enhances the expressive ability of the model by introducing spatial encodings of geometric and lobe information.
- **Alleviating Defects of Traditional GNNs**: MVGT is based on Graph Transformer, avoiding the common problems of over - smoothing, under - reaching, and over - squashing in traditional GNNs.
- **Spatial Encoding**: MVGT introduces two new spatial encoding methods - brain region encoding and geometric structure encoding - to better capture the correlations between channels.
3. **Experimental Verification**:
- Through experiments on the public datasets SEED and SEED - IV, it has been proven that the MVGT model has superior performance in emotion classification tasks, surpassing the existing baseline models.
### Summary
The main contribution of this paper is the proposal of a new multi - view graph transformer model MVGT, which can effectively integrate information in the time, frequency, and spatial domains, and significantly improve the accuracy of EEG emotion recognition by introducing spatial encodings of geometric and anatomical structures. The experimental results show that MVGT has achieved excellent performance on multiple public datasets, verifying its effectiveness and superiority.