Abstract:Past reward associations may be signaled from different sensory modalities; however, it remains unclear how different types of reward-associated stimuli modulate sensory perception. In this human fMRI study (female and male participants), a visual target was simultaneously presented with either an intra- (visual) or a cross-modal (auditory) cue that was previously associated with rewards. We hypothesized that, depending on the sensory modality of the cues, distinct neural mechanisms underlie the value-driven modulation of visual processing. Using a multivariate approach, we confirmed that reward-associated cues enhanced the target representation in early visual areas and identified the brain valuation regions. Then, using an effective connectivity analysis, we tested three possible patterns of connectivity that could underlie the modulation of the visual cortex: a direct pathway from the frontal valuation areas to the visual areas, a mediated pathway through the attention-related areas, and a mediated pathway that additionally involved sensory association areas. We found evidence for the third model demonstrating that the reward-related information in both sensory modalities is communicated across the valuation and attention-related brain regions. Additionally, the superior temporal areas were recruited when reward was cued cross-modally. The strongest dissociation between the intra- and cross-modal reward-driven effects was observed at the level of the feedforward and feedback connections of the visual cortex estimated from the winning model. These results suggest that, in the presence of previously rewarded stimuli from different sensory modalities, a combination of domain-general and domain-specific mechanisms are recruited across the brain to adjust the visual perception.SIGNIFICANCE STATEMENT Reward has a profound effect on perception, but it is not known whether shared or disparate mechanisms underlie the reward-driven effects across sensory modalities. In this human fMRI study, we examined the reward-driven modulation of the visual cortex by visual (intra-modal) and auditory (cross-modal) reward-associated cues. Using a model-based approach to identify the most plausible pattern of inter-regional effective connectivity, we found that higher-order areas involved in the valuation and attentional processing were recruited by both types of rewards. However, the pattern of connectivity between these areas and the early visual cortex was distinct between the intra- and cross-modal rewards. This evidence suggests that, to effectively adapt to the environment, reward signals may recruit both domain-general and domain-specific mechanisms.

Pulvinar Response Profiles and Connectivity Patterns to Object Domains

Multiple Visuotopically Organized Subdivisions of the Lateral Pulvinar/Central Lateral Inferior Pulvinar Project into Thin and Thick Stripe Compartments of V2 in Macaques.

Functional specialization and distributed processing across marmoset lateral prefrontal subregions

Functional Subdomains within Scene-Selective Cortex: Parahippocampal Place Area, Retrosplenial Complex, and Occipital Place Area

Distinct Response Properties Between the FFA to Faces and the PPA to Houses

Domain Selectivity in the Parahippocampal Gyrus is Predicted by the Same Structural Connectivity Patterns in Blind and Sighted Individuals.

Functional Topography of Pulvinar-Visual Cortex Networks in Macaques Revealed by INS-fMRI

Domain-specific Functional Coupling Between Dorsal and Ventral Systems During Action Perception.

A Comprehensive Visual Featural Map in the Human Ventral Temporal Cortex

Multiple focal pulvinar projection fields in the macaque cortex

Spatiotemporal and sensory modality attention processing with domain-specific representations in frontoparietal areas

Convergent functional architecture of the superior parietal lobule unraveled with multimodal neuroimaging approaches.

Prefrontal Cortex subregions provide distinct visual and behavioral feedback modulation to the Primary Visual Cortex

Principles Governing the Topological Organization of Object Selectivities in Ventral Temporal Cortex

Object Domain and Modality in the Ventral Visual Pathway.

The Effects of Different Types of Human-Object Interactions on the Ventral Occipitotemporal Cortex

Mapping Domain-Selective and Counterpointed Domain-General Higher Cognitive Functions in the Lateral Parietal Cortex: Evidence from fMRI Comparisons of Difficulty-Varying Semantic Versus Visuo-Spatial Tasks, and Functional Connectivity Analyses

Distinct Patterns of Connectivity between Brain Regions Underlie the Intra-Modal and Cross-Modal Value-Driven Modulations of the Visual Cortex

Adaptive Pulvinar Circuitry Supports Visual Cognition

Nonuniform and Pathway-Specific Laminar Processing of Spatial Frequencies in the Primary Visual Cortex of Primates