Abstract:Previous reports have described that neural activities in midbrain dopamine areas are sensitive to unexpected reward delivery and omission. These activities are correlated with reward prediction error in reinforcement learning models, the difference between predicted reward values and the obtained reward outcome. These findings suggest that the reward prediction error signal in the brain updates reward prediction through stimulus-reward experiences. It remains unknown, however, how sensory processing of reward-predicting stimuli contributes to the computation of reward prediction error. To elucidate this issue, we examined the relation between stimulus discriminability of the reward-predicting stimuli and the reward prediction error signal in the brain using functional magnetic resonance imaging (fMRI). Before main experiments, subjects learned an association between the orientation of a perceptually salient (high-contrast) Gabor patch and a juice reward. The subjects were then presented with lower-contrast Gabor patch stimuli to predict a reward. We calculated the correlation between fMRI signals and reward prediction error in two reinforcement learning models: a model including the modulation of reward prediction by stimulus discriminability and a model excluding this modulation. Results showed that fMRI signals in the midbrain are more highly correlated with reward prediction error in the model that includes stimulus discriminability than in the model that excludes stimulus discriminability. No regions showed higher correlation with the model that excludes stimulus discriminability. Moreover, results show that the difference in correlation between the two models was significant from the first session of the experiment, suggesting that the reward computation in the midbrain was modulated based on stimulus discriminability before learning a new contingency between perceptually ambiguous stimuli and a reward. These results suggest that the human reward system can incorporate the level of the stimulus discriminability flexibly into reward computations by modulating previously acquired reward values for a typical stimulus.

Signal Interaction Between Prefrontal Cortex and Striatum in Reward Prediction

Reward Prediction in Prefrontal Cortex and Striatum

Dissociable Functions of Reward Inference in the Lateral Prefrontal Cortex and the Striatum

Reward Prediction Based on Stimulus Categorization in Primate Lateral Prefrontal Cortex

Reward-Modulated Functional Connectivity Between Prefrontal Cortex and Striatum

Causal Interaction Between Prefrontal Cortex and Striatum Estimated by Granger Causality

Reward Inference by Primate Prefrontal and Striatal Neurons

[Reward information encoded by power of local field potentials in the primate prefrontal cortex and striatum].

Stimulus and reward information encoded by population neurons in the primate prefrontal cortex and striatum

Quantitative Analysis of Functional Connectivity Between Prefrontal Cortex and Striatum in Monkey

Functional Connectivity Between Prefrontal Cortex and Striatum Estimated by Phase Locking Value

Differences In Reward Processing Between Putative Cell Types In Primate Prefrontal Cortex

Movement-independent representation of reward-predicting cues in the medial part of the primate premotor cortex

Category Inference and Prefrontal Cortex

Anticipatory Activity in Rat Medial Prefrontal Cortex During a Working Memory Task

Autocorrelation Structure in the Macaque Dorsolateral, But not Orbital or Polar, Prefrontal Cortex Predicts Response-Coding Strength in a Visually Cued Strategy Task

Cross-modal and cross-temporal association in neurons of frontal cortex

A Comparison of Reward Values Encoding Function Between the Prefrontal Cortex and Striatum in Monkey

Prefrontal Neurons Encode Actions and Outcomes in Conjunction with Spatial Location in Rats Performing a Dynamic Delayed Non-Match to Position Task

CT Morphology and Outcome in Schizophrenia

Stimulus-dependent adjustment of reward prediction error in the midbrain