Abstract:BackgroundElectroencephalogram (EEG) is widely used in emotion recognition due to its precision and reliability. However, the nonstationarity of EEG signals causes significant differences between individuals or sessions, making it challenging to construct a robust model. Recently, domain adaptation (DA) methods have shown excellent results in cross-subject EEG emotion recognition by aligning marginal distributions. Nevertheless, these methods do not consider emotion category labels, which can lead to label confusion during alignment. Our study aims to alleviate this problem by promoting conditional distribution alignment during domain adaptation to improve cross-subject and cross-session emotion recognition performance.MethodThis study introduces a multi-source domain adaptation common-branch network for EEG emotion recognition and proposes a novel sample hybridization method. This method enables the introduction of target domain data information by directionally hybridizing source and target domain samples without increasing the overall sample size, thereby enhancing the effectiveness of conditional distribution alignment in domain adaptation. Cross-subject and cross-session experiments were conducted on two publicly available datasets, SEED and SEED-IV, to validate the proposed model.ResultIn cross-subject emotion recognition, our method achieved an average accuracy of 90.27% on the SEED dataset, with eight out of 15 subjects attaining a recognition accuracy higher than 90%. For the SEED-IV dataset, the recognition accuracy also reached 73.21%. Additionally, in the cross-session experiment, we sequentially used two out of the three session data as source domains and the remaining session as the target domain for emotion recognition. The proposed model yielded average accuracies of 94.16 and 75.05% on the two datasets, respectively.ConclusionOur proposed method aims to alleviate the difficulties of emotion recognition from the limited generalization ability of EEG features across subjects and sessions. Though adapting the multi-source domain adaptation and the sample hybridization method, the proposed method can effectively transfer the emotion-related knowledge of known subjects and achieve accurate emotion recognition on unlabeled subjects.

DA-CapsNet: A multi-branch capsule network based on adversarial domain adaption for cross-subject EEG emotion recognition

Multi-view Domain-Adaptive Representation Learning for EEG-based Emotion Recognition

Multi-channel EEG-based emotion recognition via a multi-level features guided capsule network

Multi-Source EEG Emotion Recognition via Dynamic Contrastive Domain Adaptation

MASTF-net: An EEG Emotion Recognition Network Based on Multi-Source Domain Adaptive Method Based on Spatio-Temporal Image and Frequency Domain Information

An Adversarial Discriminative Temporal Convolutional Network for EEG-based Cross-Domain Emotion Recognition

A Convolution and Attention-Based Conditional Adversarial Domain Adaptation Neural Network for Emotion Recognition Using Electroencephalography

MES-CTNet: A Novel Capsule Transformer Network Base on a Multi-Domain Feature Map for Electroencephalogram-Based Emotion Recognition

TC-Net: A Transformer Capsule Network for EEG-based emotion recognition

Emotion recognition from EEG based on multi-task learning with capsule network and attention mechanism

Multi-source Domain Adaptation for EEG Emotion Recognition Based on Inter-Domain Sample Hybridization

Multi-source Domain Adaptation with Spatio-Temporal Feature Extractor for EEG Emotion Recognition

Multi-Region and Multi-Band Electroencephalogram Emotion Recognition Based on Self-Attention and Capsule Network

Cross-Subject EEG Emotion Recognition Using Domain Adaptive Few-Shot Learning Networks.

Multi-Subdomain Adversarial Network for Cross-Subject EEG-based Emotion Recognition

A Novel Caps-Eegnet Combined with Channel Selection for EEG-based Emotion Recognition

Multi-source joint domain adaptation for cross-subject and cross-session emotion recognition from electroencephalography

EEG-based Emotion Recognition Using Domain Adaptation Network

Multi-Source Co-adaptation for EEG-Based Emotion Recognition by Mining Correlation Information

Multi-source Selective Graph Domain Adaptation Network for cross-subject EEG emotion recognition

A Deep Multi-Source Adaptation Transfer Network for Cross-Subject Electroencephalogram Emotion Recognition.