Abstract:Determining and decoding emotional brain processes under ecologically valid conditions remains a key challenge in affective neuroscience. The current functional magnetic resonance imaging (fMRI) based emotion decoding studies are mainly based on brief and isolated episodes of emotion induction, while sustained emotional experience in naturalistic environments that mirror daily life experiences are scarce. Here we use 10-minute movie clips as ecologically valid emotion-evoking procedures in n=52 individuals to explore emotion-specific fMRI functional connectivity (FC) profiles on the whole-brain level at high spatial resolution (400 atlas based parcels). Employing machine-learning based decoding and cross validation procedures allowed to develop predictive FC profiles that can accurately distinguish sustained happiness and sadness and that generalize across movies and subjects. Both functional brain network-based and subnetwork-based emotion prediction results suggest that emotion manifests as distributed representation of multiple networks, rather than a single functional network or subnetwork. Further, the results show that the Visual Network (VN) and Default Mode Network (DMN) associated functional networks, especially VN-DMN, exhibit a strong contribution to emotion prediction. To further estimate the cumulative effect of naturalistic long-term movie-based video-evoking emotions, we divide the 10-min episode into three stages: early stimulation (1 ~ 200 s), middle stimulation (201 ~ 400 s), and late stimulation (401 ~ 600 s) and examine the emotion prediction performance at different stimulation stages. We found that the late stimulation has a stronger predictive ability (accuracy=85.32%, F1-score=85.62%) compared to early and middle stimulation stages, implying that continuous exposure to emotional stimulation can lead to more intense emotions and further enhance emotion-specific distinguishable representations. The present work demonstrates that sustained sadness and happiness under naturalistic conditions are presented in emotion-specific network profiles and these expressions may play different roles in the generation and modulation of emotions. These findings elucidate the importance of network level adaptations for sustained emotional experiences during naturalistic contexts and open new venues for imaging network level contributions under naturalistic conditions.

Variation is the Norm: Brain State Dynamics Evoked By Emotional Video Clips

Neural Responses During Emotion Transitions and Emotion Regulation

Moving toward reality: Electrocortical reactivity to naturalistic multimodal emotional videos

Differentiation Analysis of Continuous Electroencephalographic Activity Triggered by Video Clip Contents

Whole-Brain fMRI Functional Connectivity Signatures Predict Sustained Emotional Experience in Naturalistic Contexts

Consistency of affective responses to naturalistic stimuli across individuals using intersubject correlation analysis based on neuroimaging data

Analysis of Microstate Organization During Emotional Events

Functional connectivity dynamics during film viewing reveal common networks for different emotional experiences

Similar brains blend emotion in similar ways: Neural representations of individual difference in emotion profiles

Emotion induction modulates neural dynamics during ideational originality

Neural patterns associated with mixed valence feelings differ in consistency and predictability throughout the brain

Exploring EEG Microstates for Affective Computing: Decoding Valence and Arousal Experiences During Video Watching

Dynamic Neural Patterns of Human Emotions in Virtual Reality: Insights from EEG Microstate Analysis

How emotion is experienced and expressed in multiple cultures: a large-scale experiment across North America, Europe, and Japan

Movie viewing elicits rich and reliable brain state dynamics

Differential Brain Activation for Four Emotions in VR-2D and VR-3D Modes

Electrophysiological Representations of Multivariate Human Emotion Experience

Recognition of Emotion by Brain Connectivity and Eye Movement

Brain activity correlates with emotional perception induced by dynamic avatars

Multivariate pattern classification reveals autonomic and experiential representations of discrete emotions.

The EEG Microstate Representation of Discrete Emotions.