Abstract:Past reward associations may be signaled from different sensory modalities; however, it remains unclear how different types of reward-associated stimuli modulate sensory perception. In this human fMRI study (female and male participants), a visual target was simultaneously presented with either an intra- (visual) or a cross-modal (auditory) cue that was previously associated with rewards. We hypothesized that, depending on the sensory modality of the cues, distinct neural mechanisms underlie the value-driven modulation of visual processing. Using a multivariate approach, we confirmed that reward-associated cues enhanced the target representation in early visual areas and identified the brain valuation regions. Then, using an effective connectivity analysis, we tested three possible patterns of connectivity that could underlie the modulation of the visual cortex: a direct pathway from the frontal valuation areas to the visual areas, a mediated pathway through the attention-related areas, and a mediated pathway that additionally involved sensory association areas. We found evidence for the third model demonstrating that the reward-related information in both sensory modalities is communicated across the valuation and attention-related brain regions. Additionally, the superior temporal areas were recruited when reward was cued cross-modally. The strongest dissociation between the intra- and cross-modal reward-driven effects was observed at the level of the feedforward and feedback connections of the visual cortex estimated from the winning model. These results suggest that, in the presence of previously rewarded stimuli from different sensory modalities, a combination of domain-general and domain-specific mechanisms are recruited across the brain to adjust the visual perception.SIGNIFICANCE STATEMENT Reward has a profound effect on perception, but it is not known whether shared or disparate mechanisms underlie the reward-driven effects across sensory modalities. In this human fMRI study, we examined the reward-driven modulation of the visual cortex by visual (intra-modal) and auditory (cross-modal) reward-associated cues. Using a model-based approach to identify the most plausible pattern of inter-regional effective connectivity, we found that higher-order areas involved in the valuation and attentional processing were recruited by both types of rewards. However, the pattern of connectivity between these areas and the early visual cortex was distinct between the intra- and cross-modal rewards. This evidence suggests that, to effectively adapt to the environment, reward signals may recruit both domain-general and domain-specific mechanisms.

Efficient value encoding through convergence of tactile and visual value information in the primate putamen

Convergent representation of values from tactile and visual inputs for efficient goal-directed behavior in the primate putamen

Neural geometry efficiently representing abstract form of value and modality in the primate basal ganglia

Dynamic coding and sequential integration of multiple reward attributes by primate amygdala neurons

Neuronal connections of direct and indirect pathways for stable value memory in caudal basal ganglia

Distinct representation of cognitive flexibility and habitual stability in the primate putamen, caudate, and ventral striatum

A neural mechanism for conserved value computations integrating information and rewards

Transformation of valence signaling in a striatopallidal circuit

Stimulus selection drives value-modulated somatosensory processing in superior colliculus

Transformation of valence signaling in a mouse striatopallidal circuit

Stimulus and reward information encoded by population neurons in the primate prefrontal cortex and striatum

Transformations of sensory information in the brain suggest changing criteria for optimality

Value-driven attentional priority signals in human basal ganglia and visual cortex

Applying the Efficient Coding Principle to Understand Encoding of Multisensory and Multimodality Sensory Signals

Differential and temporally dynamic involvement of primate amygdala nuclei in face animacy and reward information processing

Distinct attentional profile and functional connectivity of neurons with visual feature coding in the primate brain

Cross-Modal Integration of Reward Value during Oculomotor Planning

The Effect of Counterfactual Information on Outcome Value Coding in Medial Prefrontal and Cingulate Cortex: From an Absolute to a Relative Neural Code

Limited encoding of effort by dopamine neurons in a cost-benefit trade-off task

Distinct visual processing networks for foveal and peripheral visual fields

Distinct Patterns of Connectivity between Brain Regions Underlie the Intra-Modal and Cross-Modal Value-Driven Modulations of the Visual Cortex