Abstract:Past reward associations may be signaled from different sensory modalities; however, it remains unclear how different types of reward-associated stimuli modulate sensory perception. In this human fMRI study (female and male participants), a visual target was simultaneously presented with either an intra- (visual) or a cross-modal (auditory) cue that was previously associated with rewards. We hypothesized that, depending on the sensory modality of the cues, distinct neural mechanisms underlie the value-driven modulation of visual processing. Using a multivariate approach, we confirmed that reward-associated cues enhanced the target representation in early visual areas and identified the brain valuation regions. Then, using an effective connectivity analysis, we tested three possible patterns of connectivity that could underlie the modulation of the visual cortex: a direct pathway from the frontal valuation areas to the visual areas, a mediated pathway through the attention-related areas, and a mediated pathway that additionally involved sensory association areas. We found evidence for the third model demonstrating that the reward-related information in both sensory modalities is communicated across the valuation and attention-related brain regions. Additionally, the superior temporal areas were recruited when reward was cued cross-modally. The strongest dissociation between the intra- and cross-modal reward-driven effects was observed at the level of the feedforward and feedback connections of the visual cortex estimated from the winning model. These results suggest that, in the presence of previously rewarded stimuli from different sensory modalities, a combination of domain-general and domain-specific mechanisms are recruited across the brain to adjust the visual perception.SIGNIFICANCE STATEMENT Reward has a profound effect on perception, but it is not known whether shared or disparate mechanisms underlie the reward-driven effects across sensory modalities. In this human fMRI study, we examined the reward-driven modulation of the visual cortex by visual (intra-modal) and auditory (cross-modal) reward-associated cues. Using a model-based approach to identify the most plausible pattern of inter-regional effective connectivity, we found that higher-order areas involved in the valuation and attentional processing were recruited by both types of rewards. However, the pattern of connectivity between these areas and the early visual cortex was distinct between the intra- and cross-modal rewards. This evidence suggests that, to effectively adapt to the environment, reward signals may recruit both domain-general and domain-specific mechanisms.

When "Your" reward is the same as "My" reward: Self-construal priming shifts neural responses to own vs. friends' rewards.

The influence of self-construals on the ERP response to the rewards for self and mother

Mothers exhibit higher neural activity in gaining rewards for their children than for themselves

Distraction Modulates Self-Referential Effects in the Processing of Monetary and Social Rewards

Happy for Us not Them: Differences in neural activation in a vicarious reward task between family and strangers during adolescent development

Functional Connectivity Between Motor and Mid-Frontal Areas During Vicarious Reward Revealed via EEG Time-Frequency Analysis

Self-construal priming modulates neural substrates of self-awareness.

Empathic Responses to Others’ Gains and Losses: an Electrophysiological Investigation

Whose loss is it? Human electrophysiological correlates of non-self reward processing

Gain–loss situation modulates neural responses to self–other decision making under risk

Dynamic cultural modulation of neural responses to one's own and friend's faces.

Distinct neural representations for prosocial and self-benefiting effort

Risk decision: The self-charity discrepancies in electrophysiological responses to outcome evaluation

P2 Manifests Subjective Evaluation of Reward Processing Under Social Comparison

Dynamic Cultural Modulation of Neural Responses to One's Own and Friend's Faces

Neural asymmetry in aligning with generous versus selfish descriptive norms in a charitable donation task

Love is analogous to money in human brain: Coordinate-based and functional connectivity meta-analyses of social and monetary reward anticipation

When "more for others, less for self" leads to co‐benefits: A tri‐MRI dyad‐hyperscanning study

Distinct Patterns of Connectivity between Brain Regions Underlie the Intra-Modal and Cross-Modal Value-Driven Modulations of the Visual Cortex

Distinct effects of self-construal priming on empathic neural responses in Chinese and Westerners.

Expectations of immediate and delayed reward differentially affect cognitive task performance