Abstract:BackgroundElectroencephalogram (EEG) is widely used in emotion recognition due to its precision and reliability. However, the nonstationarity of EEG signals causes significant differences between individuals or sessions, making it challenging to construct a robust model. Recently, domain adaptation (DA) methods have shown excellent results in cross-subject EEG emotion recognition by aligning marginal distributions. Nevertheless, these methods do not consider emotion category labels, which can lead to label confusion during alignment. Our study aims to alleviate this problem by promoting conditional distribution alignment during domain adaptation to improve cross-subject and cross-session emotion recognition performance.MethodThis study introduces a multi-source domain adaptation common-branch network for EEG emotion recognition and proposes a novel sample hybridization method. This method enables the introduction of target domain data information by directionally hybridizing source and target domain samples without increasing the overall sample size, thereby enhancing the effectiveness of conditional distribution alignment in domain adaptation. Cross-subject and cross-session experiments were conducted on two publicly available datasets, SEED and SEED-IV, to validate the proposed model.ResultIn cross-subject emotion recognition, our method achieved an average accuracy of 90.27% on the SEED dataset, with eight out of 15 subjects attaining a recognition accuracy higher than 90%. For the SEED-IV dataset, the recognition accuracy also reached 73.21%. Additionally, in the cross-session experiment, we sequentially used two out of the three session data as source domains and the remaining session as the target domain for emotion recognition. The proposed model yielded average accuracies of 94.16 and 75.05% on the two datasets, respectively.ConclusionOur proposed method aims to alleviate the difficulties of emotion recognition from the limited generalization ability of EEG features across subjects and sessions. Though adapting the multi-source domain adaptation and the sample hybridization method, the proposed method can effectively transfer the emotion-related knowledge of known subjects and achieve accurate emotion recognition on unlabeled subjects.

Two-Level Domain Adaptation Neural Network for EEG-Based Emotion Recognition.

Multi-view Domain-Adaptive Representation Learning for EEG-based Emotion Recognition

EEG-based Emotion Recognition Using Domain Adaptation Network

A Convolution and Attention-Based Conditional Adversarial Domain Adaptation Neural Network for Emotion Recognition Using Electroencephalography

An Adversarial Discriminative Temporal Convolutional Network for EEG-based Cross-Domain Emotion Recognition

Knowledge distillation based lightweight domain adversarial neural network for electroencephalogram-based emotion recognition

Multiple-source distribution deep adaptive feature norm network for EEG emotion recognition

TMLP+SRDANN: A Domain Adaptation Method for EEG-based Emotion Recognition

Dynamic Domain Adaptation for Class-Aware Cross-Subject and Cross-Session EEG Emotion Recognition

A Deep Subdomain Associate Adaptation Network for Cross-Session and Cross-Subject Eeg Emotion Recognition

Hybrid transfer learning strategy for cross-subject EEG emotion recognition

GLADA: Global and Local Associative Domain Adaptation for EEG-based Emotion Recognition

Multi-source Domain Adaptation for EEG Emotion Recognition Based on Inter-Domain Sample Hybridization

A Deep Multi-Source Adaptation Transfer Network for Cross-Subject Electroencephalogram Emotion Recognition.

A Lightweight Domain Adversarial Neural Network Based on Knowledge Distillation for EEG-based Cross-subject Emotion Recognition

Multi-Source EEG Emotion Recognition via Dynamic Contrastive Domain Adaptation

Domain Adaptation Techniques for EEG-Based Emotion Recognition: A Comparative Study on Two Public Datasets

EEG-based cross-subject emotion recognition using multi-source domain transfer learning

Local domain generalization with low-rank constraint for EEG-based emotion recognition

Multi-source Domain Adaptation with Spatio-Temporal Feature Extractor for EEG Emotion Recognition

A Bi-Hemisphere Domain Adversarial Neural Network Model for EEG Emotion Recognition