Abstract:Neuroscience study has revealed the discrepancy of emotion expression between the left and right hemispheres of human brain. Inspired by this study, in this article, we propose a novel bi-hemispheric discrepancy model (BiHDM) to learn this discrepancy information between the two hemispheres to improve electroencephalograph (EEG) emotion recognition. Concretely, we first employ four directed recurrent neural networks (RNNs) based on two spatial orientations to traverse electrode signals on two separate brain regions. This enables the proposed model to obtain the deep representations of all the EEG electrodes' signals that keep their intrinsic spatial dependence. Upon this representation, a pairwise subnetwork is designed to explicitly capture the discrepancy information between the two hemispheres and extract higher level features for final classification. Furthermore, considering the presence of the domain shift between training and testing data, we incorporate a domain discriminator that adversarially induces the overall feature learning module to generate emotion related but domain-invariant feature representation so as to further promote EEG emotion recognition. Experiments are conducted on three public EEG emotional data sets, in which we evaluate the performance of the proposed BiHDM as well as investigated the important brain areas in emotion expression and explore to use less electrodes to achieve comparable results. These experimental results jointly demonstrate the effectiveness and advantage of the proposed BiHDM model in solving the EEG emotion recognition problem.

What problem does this paper attempt to address?

The paper primarily aims to address two key issues in the field of emotion recognition: 1. **How to extract features highly relevant to emotions**: Most existing methods use handcrafted features (such as statistics, power spectral density, etc.). While these features can extract some emotion-discriminative information, they do not fully exploit emotion-specific information. The authors point out that since there are differences in how the left and right hemispheres of the human brain express emotions, this difference can be used as emotion-specific information to improve emotion recognition performance. 2. **How to improve the generalization ability of the model**: Due to the high heterogeneity and non-stationary nature of electroencephalogram (EEG) signals, there may be distribution differences between data obtained from different individuals, which limits the model's ability to generalize to new data. This is particularly challenging in cross-subject emotion recognition tasks, where the training and testing data come from different individuals, leading to potential data distribution shifts. To address the above issues, the paper proposes a new neural network model—the Bi-Hemispheric Discrepancy Model (BiHDM). The model achieves its goals through the following steps: - First, four direction-based recurrent neural networks (RNNs) are used to process the electrode signals from the left and right brain regions separately, maintaining the spatial dependencies of the signals and extracting deep representations. - Then, a paired network is designed to explicitly capture the discrepancy information between the left and right hemispheres and extract higher-level features for final classification. - Additionally, considering the domain shift between the training and testing sets, the model introduces a domain discriminator. This discriminator adversarially encourages the entire feature learning module to generate feature representations that are both emotion-relevant and domain-invariant, thereby further enhancing the effectiveness of EEG emotion recognition. The experimental section evaluates the proposed BiHDM model using three publicly available EEG emotion datasets, validating its effectiveness and advantages. Furthermore, the paper explores which electrodes are more closely related to emotion recognition and how to select a smaller number of electrodes while maintaining recognition performance.

A Novel Bi-Hemispheric Discrepancy Model for EEG Emotion Recognition

Multi-view Domain-Adaptive Representation Learning for EEG-based Emotion Recognition

A Novel Neural Network Model based on Cerebral Hemispheric Asymmetry for EEG Emotion Recognition

A Bi-Hemisphere Domain Adversarial Neural Network Model for EEG Emotion Recognition

Differences first in asymmetric brain: A bi-hemisphere discrepancy convolutional neural network for EEG emotion recognition

An Attention-Based Multi-Domain Bi-Hemisphere Discrepancy Feature Fusion Model for EEG Emotion Recognition

Simultaneously exploring multi-scale and asymmetric EEG features for emotion recognition

From Regional to Global Brain: A Novel Hierarchical Spatial-Temporal Neural Network Model for EEG Emotion Recognition

EEG-Based Emotion Recognition Using Hierarchical Network with Subnetwork Nodes

A Bi-Stream hybrid model with MLPBlocks and self-attention mechanism for EEG-based emotion recognition

Multidimensional Feature in Emotion Recognition Based on Multi-Channel EEG Signals.

Human Emotion Recognition with Electroencephalographic Multidimensional Features by Hybrid Deep Neural Networks

EEG Emotion Recognition of Different Brain Regions Based on 2DCNN-DGRU

Deep Spatio-Temporal Mutual Learning for EEG Emotion Recognition

The Dual-3DCRU Model Based on Hemisphere Asymmetry for EEG Emotion Recognition

Investigating EEG-based functional connectivity patterns for multimodal emotion recognition

A Model for EEG-Based Emotion Recognition: CNN-Bi-LSTM with Attention Mechanism

Minimizing EEG Human Interference: A Study of an Adaptive EEG Spatial Feature Extraction with Deep Convolutional Neural Networks

A Novel DE-CNN-BiLSTM Multi-Fusion Model for EEG Emotion Recognition

Sentiment Recognition Model of EEG Signals Combined with One-Dimensional Convolution and BiBASRU-AT

EEG emotion recognition based on enhanced SPD matrix and manifold dimensionality reduction