Abstract:Abstract The perception of opportunities and threats in complex scenes represents one of the main functions of the human visual system. In the laboratory, its neurophysiological basis is often studied by having observers view pictures varying in affective content. This body of work has consistently shown that viewing emotionally engaging, compared to neutral, pictures (1) heightens blood flow in limbic structures and frontoparietal cortex, as well as in anterior ventral and dorsal visual cortex, and (2) prompts an increase in the late positive event-related potential (LPP), a scalp-recorded and time-sensitive index of engagement within the network of aforementioned neural structures. The role of retinotopic visual cortex in this process has, however, been contentious, with competing theoretical notions predicting the presence versus absence of emotion-specific signals in retinotopic visual areas. The present study used multimodal neuroimaging and machine learning to address this question by examining the large-scale neural representations of affective pictures. Recording EEG and fMRI simultaneously while observers viewed pleasant, unpleasant, and neutral affective pictures, and applying multivariate pattern analysis to single-trial BOLD activities in retinotopic visual cortex, we identified three robust findings: First, unpleasant-versus-neutral decoding accuracy, as well as pleasant-versus-neutral decoding accuracy, were well above chance level in all retinotopic visual areas, including primary visual cortex. Second, the decoding accuracy in ventral visual cortex, but not in early visual cortex or dorsal visual cortex, was significantly correlated with LPP amplitude. Third, effective connectivity from amygdala to ventral visual cortex predicted unpleasant-versus-neutral decoding accuracy, and effective connectivity from ventral frontal cortex to ventral visual cortex predicted pleasant-versus-neutral decoding accuracy. These results suggest that affective pictures evoked valence-specific multivoxel neural representations in retinotopic visual cortex and that these multivoxel representations were influenced by reentry signals from limbic and frontal brain regions.

Spatiotemporal Analysis of Single-Trial EEG of Emotional Pictures Based on Independent Component Analysis and Source Location

Gender Differences in the Processing of Standard Emotional Visual Stimuli: Integrating ERP and Fmri Results

Combination of PCA and LORETA for Sources Analysis of ERP Data: an Emotional Processing Study

A study of neural mechanism in emotion regulation by simultaneous recording of EEG and fMRI based on ICA

Feature Fusion Analysis of Simultaneously Recorded EEG-fMRI in Emotion Cognitive Reappraisal

Study on Differences of Early-Mid ERPs Induced by Emotional Face and Scene Images.

Study of Emotional Brain Mechanism Based on Functional Magnetic Resonance Imaging

Investigating Oscillatory Activity in Cerebral Cortex during Affective Picture Processing

Separate neural networks of implicit emotional processing between pictures and words: A coordinate-based meta-analysis of brain imaging studies

Analysis of Affective Effects on Steady-State Visual Evoked Potential Responses.

N170 Component Analysis of Single-Trial EEG Based on Electrophysiological Source Imaging.

A Detailed Study on the Modulation of Emotion Processing by Spatial Location

Decoding Multivoxel Representations of Affective Scenes in Retinotopic Visual Cortex

Functional MRI Study on the Involvement of Amygdala in Sustained and Transient Effects of Emotional Memory

Functional MRI in Study of Sustained and Transient Effects in Encoding Processes of Emotional Memory

Recognition of Emotion by Brain Connectivity and Eye Movement

Decoding the Temporal Dynamics of Affective Scene Processing

Cortical Activity after Emotional Visual Stimulation in Minimally Conscious State Patients

Single Trial Evoked Potentials Study during an Emotional Processing Based on Wavelet Transform

Frequency Dependent Emotion Differentiation and Directional Coupling in Amygdala, Orbitofrontal and Medial Prefrontal Cortex Network with Intracranial Recordings

Neural Mechanisms of Social Emotion Perception: an EEG Hyper-Scanning Study