Abstract:BackgroundElectroencephalogram (EEG) is widely used in emotion recognition due to its precision and reliability. However, the nonstationarity of EEG signals causes significant differences between individuals or sessions, making it challenging to construct a robust model. Recently, domain adaptation (DA) methods have shown excellent results in cross-subject EEG emotion recognition by aligning marginal distributions. Nevertheless, these methods do not consider emotion category labels, which can lead to label confusion during alignment. Our study aims to alleviate this problem by promoting conditional distribution alignment during domain adaptation to improve cross-subject and cross-session emotion recognition performance.MethodThis study introduces a multi-source domain adaptation common-branch network for EEG emotion recognition and proposes a novel sample hybridization method. This method enables the introduction of target domain data information by directionally hybridizing source and target domain samples without increasing the overall sample size, thereby enhancing the effectiveness of conditional distribution alignment in domain adaptation. Cross-subject and cross-session experiments were conducted on two publicly available datasets, SEED and SEED-IV, to validate the proposed model.ResultIn cross-subject emotion recognition, our method achieved an average accuracy of 90.27% on the SEED dataset, with eight out of 15 subjects attaining a recognition accuracy higher than 90%. For the SEED-IV dataset, the recognition accuracy also reached 73.21%. Additionally, in the cross-session experiment, we sequentially used two out of the three session data as source domains and the remaining session as the target domain for emotion recognition. The proposed model yielded average accuracies of 94.16 and 75.05% on the two datasets, respectively.ConclusionOur proposed method aims to alleviate the difficulties of emotion recognition from the limited generalization ability of EEG features across subjects and sessions. Though adapting the multi-source domain adaptation and the sample hybridization method, the proposed method can effectively transfer the emotion-related knowledge of known subjects and achieve accurate emotion recognition on unlabeled subjects.

A Domain-aware Language-supervised Method for Image Emotion Classification

Image Emotional Semantic Retrieval Based on ELM

Multi-view Domain-Adaptive Representation Learning for EEG-based Emotion Recognition

Joint Weakly Supervised Image Emotion Analysis Based on Interclass Discrimination and Intraclass Correlation

One for All: A Unified Generative Framework for Image Emotion Classification

Learning to Compose Diversified Prompts for Image Emotion Classification

Computational Emotion Analysis From Images: Recent Advances and Future Directions

Learning Meta-Knowledge for Few-Shot Image Emotion Recognition

Multi-Source EEG Emotion Recognition via Dynamic Contrastive Domain Adaptation

A supervised contrastive learning-based model for image emotion classification

Interpretable Image Emotion Recognition: A Domain Adaptation Approach Using Facial Expressions

Toward Label-Efficient Emotion and Sentiment Analysis

Domain Invariant Feature Learning for Speaker-Independent Speech Emotion Recognition

EmotionGAN: Unsupervised Domain Adaptation for Learning Discrete Probability Distributions of Image Emotions.

Local domain generalization with low-rank constraint for EEG-based emotion recognition

Image Emotion Computing

Easy Domain Adaptation for cross-subject multi-view emotion recognition

Adaptive Deep Metric Learning for Affective Image Retrieval and Classification

Domain adversarial learning for emotion recognition

Multi-source Domain Adaptation for EEG Emotion Recognition Based on Inter-Domain Sample Hybridization

Affective Abstract Image Classification Based on Convolutional Sparse Autoencoders across Different Domains