Abstract:In this paper, we propose a novel neural network model, called bi-hemisphere domain adversarial neural network (BiDANN) model, for electroencephalograph (EEG) emotion recognition. The BiDANN model is inspired by the neuroscience findings that the left and right hemispheres of human's brain are asymmetric to the emotional response. It contains a global and two local domain discriminators that work adversarially with a classifier to learn discriminative emotional features for each hemisphere. At the same time, it tries to reduce the possible domain differences in each hemisphere between the source and target domains so as to improve the generality of the recognition model. In addition, we also propose an improved version of BiDANN, denoted by BiDANN-S, for subject-independent EEG emotion recognition problem by lowering the influences of the personal information of subjects to the EEG emotion recognition. Extensive experiments on the SEED database are conducted to evaluate the performance of both BiDANN and BiDANN-S. The experimental results have shown that the proposed BiDANN and BiDANN models achieve state-of-the-art performance in the EEG emotion recognition.

What problem does this paper attempt to address?

The paper is primarily dedicated to addressing the issue of emotion recognition in the field of affective computing using electroencephalography (EEG), particularly focusing on the challenges of cross-domain emotion recognition. Specifically, the study proposes a new model called "Bi-Hemispheric Domain Adversarial Neural Network" (BiDANN) and further introduces its improved version, BiDANN-S, to handle subject-independent emotion recognition tasks. ### Main Issues Addressed: 1. **Cross-Domain Emotion Recognition Problem**: Most existing EEG emotion recognition methods assume that the training data and testing data come from the same distribution or domain. However, in practical applications, such as cross-subject emotion recognition, this assumption often does not hold because the EEG feature distributions may vary significantly between different individuals. Therefore, the study aims to develop methods that can mitigate the feature distribution differences between the source domain and the target domain. 2. **Utilizing Brain Hemispheric Asymmetry**: From a neuroscience perspective, the left and right hemispheres of the human brain exhibit asymmetry in emotion processing, which can be leveraged to enhance emotion recognition performance. The study utilizes this property by designing learning mechanisms specifically targeting the features of the left and right hemispheres. 3. **Handling Individual Differences**: For cross-subject emotion recognition tasks, existing methods may perform poorly due to differences between individuals (such as personal identity information). To address this issue, the study proposes the BiDANN-S model, which introduces an additional subject discriminator to reduce the impact of individual information on emotion recognition. ### Method Overview: - **BiDANN Model**: Composed of a feature extraction module, a classification module, and a domain discriminator module. The model employs two local domain discriminators (corresponding to the left and right hemispheres) and one global domain discriminator, which engage in adversarial learning with the classifier to learn discriminative emotion features for each hemisphere and reduce domain differences between the source and target domains. - **BiDANN-S Model**: As an extension of BiDANN, it adds a subject discriminator to reduce the influence of subject information on emotion recognition results, thereby improving the model's generalizability. ### Experimental Validation: - The study conducted extensive experimental validation using the SJTU Emotion EEG Dataset (SEED), including both subject-dependent and subject-independent settings. - To evaluate the contribution of different parts of BiDANN to emotion recognition performance, two simplified versions, BiDANN-R1 and BiDANN-R2, were designed and their performances were compared under the same experimental settings.

A Bi-Hemisphere Domain Adversarial Neural Network Model for EEG Emotion Recognition

A Novel Neural Network Model based on Cerebral Hemispheric Asymmetry for EEG Emotion Recognition

Multi-view Domain-Adaptive Representation Learning for EEG-based Emotion Recognition

A Novel Bi-Hemispheric Discrepancy Model for EEG Emotion Recognition

An Attention-Based Multi-Domain Bi-Hemisphere Discrepancy Feature Fusion Model for EEG Emotion Recognition

DAGAM: A domain adversarial graph attention model for subject independent EEG-based emotion recognition

Multi-Subdomain Adversarial Network for Cross-Subject EEG-based Emotion Recognition

Multi-Source EEG Emotion Recognition via Dynamic Contrastive Domain Adaptation

A Novel Domain Adversarial Networks Based on 3D-LSTM and Local Domain Discriminator for Hearing-Impaired Emotion Recognition

EEG Emotion Recognition Based on GADF and AMB‐CNN Model

A Lightweight Domain Adversarial Neural Network Based on Knowledge Distillation for EEG-based Cross-subject Emotion Recognition

Knowledge distillation based lightweight domain adversarial neural network for electroencephalogram-based emotion recognition

Multiple-source distribution deep adaptive feature norm network for EEG emotion recognition

EEG-based emotion recognition using an end-to-end regional-asymmetric convolutional neural network

Cerebral asymmetry representation learning based deep subdomain adaptation network for EEG-based emotion recognition

An attention-based hybrid deep learning model for EEG emotion recognition

Simultaneously exploring multi-scale and asymmetric EEG features for emotion recognition

Investigating Critical Frequency Bands and Channels for EEG-Based Emotion Recognition with Deep Neural Networks

DA-CapsNet: A multi-branch capsule network based on adversarial domain adaption for cross-subject EEG emotion recognition

Domain-adaptive emotion recognition based on horizontal vertical flow representation of EEG signals

4D attention-based neural network for EEG emotion recognition