Abstract:Neuroscience study has revealed the discrepancy of emotion expression between the left and right hemispheres of human brain. Inspired by this study, in this article, we propose a novel bi-hemispheric discrepancy model (BiHDM) to learn this discrepancy information between the two hemispheres to improve electroencephalograph (EEG) emotion recognition. Concretely, we first employ four directed recurrent neural networks (RNNs) based on two spatial orientations to traverse electrode signals on two separate brain regions. This enables the proposed model to obtain the deep representations of all the EEG electrodes' signals that keep their intrinsic spatial dependence. Upon this representation, a pairwise subnetwork is designed to explicitly capture the discrepancy information between the two hemispheres and extract higher level features for final classification. Furthermore, considering the presence of the domain shift between training and testing data, we incorporate a domain discriminator that adversarially induces the overall feature learning module to generate emotion related but domain-invariant feature representation so as to further promote EEG emotion recognition. Experiments are conducted on three public EEG emotional data sets, in which we evaluate the performance of the proposed BiHDM as well as investigated the important brain areas in emotion expression and explore to use less electrodes to achieve comparable results. These experimental results jointly demonstrate the effectiveness and advantage of the proposed BiHDM model in solving the EEG emotion recognition problem.

Continuous Emotion Ambiguity Prediction: Modeling with Beta Distributions

Dual-Constrained Dynamical Neural ODEs for Ambiguity-aware Continuous Emotion Prediction

Handling Ambiguity in Emotion: From Out-of-Domain Detection to Distribution Estimation

Continuous Multimodal Emotion Prediction Based on Long Short Term Memory Recurrent Neural Network

Multimodal Continuous Prediction of Emotions in Movies using Long Short-Term Memory Networks

End-to-End Label Uncertainty Modeling in Speech Emotion Recognition using Bayesian Neural Networks and Label Distribution Learning

The Whole Is Bigger Than the Sum of Its Parts: Modeling Individual Annotators to Capture Emotional Variability

Estimating the Uncertainty in Emotion Class Labels with Utterance-Specific Dirichlet Priors

Implementing machine learning techniques for continuous emotion prediction from uniformly segmented voice recordings

Time-Delay Neural Network for Continuous Emotional Dimension Prediction from Facial Expression Sequences.

Multimodal Continuous Emotion Recognition: A Technical Report for ABAW5

A Novel Bi-Hemispheric Discrepancy Model for EEG Emotion Recognition

To Improve Is to Change: Towards Improving Mood Prediction by Learning Changes in Emotion

NeuralBeta: Estimating Beta Using Deep Learning

Predicting Continuous Probability Distribution Of Image Emotions In Valence-Arousal Space

Dimensional Emotion Detection from Categorical Emotion

A Weakly Supervised Approach to Emotion-change Prediction and Improved Mood Inference

Deep Spatio-Temporal Mutual Learning for EEG Emotion Recognition

Multimodal Continuous Emotion Recognition with Data Augmentation Using Recurrent Neural Networks

AER-LLM: Ambiguity-aware Emotion Recognition Leveraging Large Language Models