Abstract:Determining and decoding emotional brain processes under ecologically valid conditions remains a key challenge in affective neuroscience. The current functional magnetic resonance imaging (fMRI) based emotion decoding studies are mainly based on brief and isolated episodes of emotion induction, while sustained emotional experience in naturalistic environments that mirror daily life experiences are scarce. Here we use 10-minute movie clips as ecologically valid emotion-evoking procedures in n=52 individuals to explore emotion-specific fMRI functional connectivity (FC) profiles on the whole-brain level at high spatial resolution (400 atlas based parcels). Employing machine-learning based decoding and cross validation procedures allowed to develop predictive FC profiles that can accurately distinguish sustained happiness and sadness and that generalize across movies and subjects. Both functional brain network-based and subnetwork-based emotion prediction results suggest that emotion manifests as distributed representation of multiple networks, rather than a single functional network or subnetwork. Further, the results show that the Visual Network (VN) and Default Mode Network (DMN) associated functional networks, especially VN-DMN, exhibit a strong contribution to emotion prediction. To further estimate the cumulative effect of naturalistic long-term movie-based video-evoking emotions, we divide the 10-min episode into three stages: early stimulation (1 ~ 200 s), middle stimulation (201 ~ 400 s), and late stimulation (401 ~ 600 s) and examine the emotion prediction performance at different stimulation stages. We found that the late stimulation has a stronger predictive ability (accuracy=85.32%, F1-score=85.62%) compared to early and middle stimulation stages, implying that continuous exposure to emotional stimulation can lead to more intense emotions and further enhance emotion-specific distinguishable representations. The present work demonstrates that sustained sadness and happiness under naturalistic conditions are presented in emotion-specific network profiles and these expressions may play different roles in the generation and modulation of emotions. These findings elucidate the importance of network level adaptations for sustained emotional experiences during naturalistic contexts and open new venues for imaging network level contributions under naturalistic conditions.

Emotional brain network decoded by biological spiking neural network

EEG Emotion Recognition Based on Self-attention Dynamic Graph Neural Networks

Emotional Analysis and Recognition Based on EEG Brain Network.

Emotion extraction based on multi bio-signal using back-propagation neural network

Differences first in asymmetric brain: A bi-hemisphere discrepancy convolutional neural network for EEG emotion recognition

EEG-Based Emotion Recognition Using Hierarchical Network with Subnetwork Nodes

EESCN: A novel spiking neural network method for EEG-based emotion recognition

Enhancing Emotion Recognition Using Region-Specific Electroencephalogram Data and Dynamic Functional Connectivity

E2ENNet: An end-to-end neural network for emotional brain-computer interface

Identifying Functional Brain Connectivity Patterns for EEG-Based Emotion Recognition.

Design and Implementation of an Emotion Analysis System Based on EEG Signals

A Novel Bi-Hemispheric Discrepancy Model for EEG Emotion Recognition

EEG-Based Emotion Recognition by Exploiting Fused Network Entropy Measures of Complex Networks Across Subjects.

Whole-Brain fMRI Functional Connectivity Signatures Predict Sustained Emotional Experience in Naturalistic Contexts

EEG Emotion Recognition Based on Spatiotemporal Self-Adaptive Graph Convolutional Neural Network

ERNN: a biologically inspired feedforward neural network to discriminate emotion from EEG signal

Emotion Classification Using EEG Data in a Brain-Inspired Spiking Neural Network

Emotional State Decoding Using EEG-based Microstates of Functional Connectivity

Dynamic differential entropy and brain connectivity features based EEG emotion recognition

Deep Sparse Autoencoder and Recursive Neural Network for EEG Emotion Recognition

EEG Microstates and Fnirs Metrics Reveal the Spatiotemporal Joint Neural Processing Features of Human Emotions