Abstract:Previous reports have described that neural activities in midbrain dopamine areas are sensitive to unexpected reward delivery and omission. These activities are correlated with reward prediction error in reinforcement learning models, the difference between predicted reward values and the obtained reward outcome. These findings suggest that the reward prediction error signal in the brain updates reward prediction through stimulus-reward experiences. It remains unknown, however, how sensory processing of reward-predicting stimuli contributes to the computation of reward prediction error. To elucidate this issue, we examined the relation between stimulus discriminability of the reward-predicting stimuli and the reward prediction error signal in the brain using functional magnetic resonance imaging (fMRI). Before main experiments, subjects learned an association between the orientation of a perceptually salient (high-contrast) Gabor patch and a juice reward. The subjects were then presented with lower-contrast Gabor patch stimuli to predict a reward. We calculated the correlation between fMRI signals and reward prediction error in two reinforcement learning models: a model including the modulation of reward prediction by stimulus discriminability and a model excluding this modulation. Results showed that fMRI signals in the midbrain are more highly correlated with reward prediction error in the model that includes stimulus discriminability than in the model that excludes stimulus discriminability. No regions showed higher correlation with the model that excludes stimulus discriminability. Moreover, results show that the difference in correlation between the two models was significant from the first session of the experiment, suggesting that the reward computation in the midbrain was modulated based on stimulus discriminability before learning a new contingency between perceptually ambiguous stimuli and a reward. These results suggest that the human reward system can incorporate the level of the stimulus discriminability flexibly into reward computations by modulating previously acquired reward values for a typical stimulus.

Functional neural interactions during adaptive reward learning: An functional magnetic resonance imaging study

Functions of Learning Rate in Adaptive Reward Learning

How Instructed Knowledge Modulates the Neural Systems of Reward Learning

Neural Dynamics of Reward-Induced Response Activation and Inhibition.

Stimulus-dependent adjustment of reward prediction error in the midbrain

Neural Substrates of Updating the Prediction Through Prediction Error During Decision Making.

Policy adjustment in a dynamic economic game

Reward boosts neural coding of task rules to optimise cognitive flexibility

Functional Alteration of the DMN by Learned Regulation of the PCC Using Real-Time Fmri

Reconfigurations of cortical manifold structure during reward-based motor learning

The Neural Correlates of Individual Differences in Reinforcement Learning during Pain Avoidance and Reward Seeking

Frontal Theta Oscillatory Activity Is a Common Mechanism for the Computation of Unexpected Outcomes and Learning Rate

Reward and expectancy effects on neural signals of motor preparation and execution

Neural activity ramps in frontal cortex signal extended motivation during learning

Exploring Neural Mechanisms of Reward Processing Using Coupled Matrix Tensor Factorization: A Simultaneous EEG–fMRI Investigation

Dissociable Functions of Reward Inference in the Lateral Prefrontal Cortex and the Striatum

Encoding Motivation Prediction Errors in the Human Dopaminergic Reward System

Parallel Contributions of Distinct Human Memory Systems During Probabilistic Learning.

Beyond Reward Prediction Errors: Human Striatum Updates Rule Values During Learning

Neural interactions in the human frontal cortex dissociate reward and punishment learning