Abstract:Learning to optimally predict rewards requires agents to account for fluctuations in reward value. Recent work suggests that individuals can efficiently learn about variable rewards through adaptation of the learning rate, and coding of prediction errors relative to reward variability. Such adaptive coding has been linked to midbrain dopamine neurons in nonhuman primates, and evidence in support for a similar role of the dopaminergic system in humans is emerging from fMRI data. Here, we sought to investigate the effect of dopaminergic perturbations on adaptive prediction error coding in humans, using a between-subject, placebo-controlled pharmacological fMRI study with a dopaminergic agonist (bromocriptine) and antagonist (sulpiride). Participants performed a previously validated task in which they predicted the magnitude of upcoming rewards drawn from distributions with varying SDs. After each prediction, participants received a reward, yielding trial-by-trial prediction errors. Under placebo, we replicated previous observations of adaptive coding in the midbrain and ventral striatum. Treatment with sulpiride attenuated adaptive coding in both midbrain and ventral striatum, and was associated with a decrease in performance, whereas bromocriptine did not have a significant impact. Although we observed no differential effect of SD on performance between the groups, computational modeling suggested decreased behavioral adaptation in the sulpiride group. These results suggest that normal dopaminergic function is critical for adaptive prediction error coding, a key property of the brain thought to facilitate efficient learning in variable environments. Crucially, these results also offer potential insights for understanding the impact of disrupted dopamine function in mental illness.SIGNIFICANCE STATEMENT To choose optimally, we have to learn what to expect. Humans dampen learning when there is a great deal of variability in reward outcome, and two brain regions that are modulated by the brain chemical dopamine are sensitive to reward variability. Here, we aimed to directly relate dopamine to learning about variable rewards, and the neural encoding of associated teaching signals. We perturbed dopamine in healthy individuals using dopaminergic medication and asked them to predict variable rewards while we made brain scans. Dopamine perturbations impaired learning and the neural encoding of reward variability, thus establishing a direct link between dopamine and adaptation to reward variability. These results aid our understanding of clinical conditions associated with dopaminergic dysfunction, such as psychosis.

Dopamine Enhanced Auditory Perceptual Learning in Humans Via Long-Term Memory Consolidation

Role of Dopamine in Learning Beyond Reinforcement: Boost of Auditory Learning and Transfer by Orally Taken or Gameplay-Generated Dopamine

Ventral tegmental area dopamine projections to the hippocampus trigger long-term potentiation and contextual learning

Dopamine Modulates Adaptive Prediction Error Coding in the Human Midbrain and Striatum

Striatal Dopamine Can Enhance Learning, Both Fast and Slow, and Also Make it Cheaper

Dopamine Increases Accuracy and Lengthens Deliberation Time in Explicit Motor Skill Learning

Dopamine Activation Preserves Visual Motion Perception Despite Noise Interference of Human V5/MT

Gain in Sensitivity and Loss in Temporal Contrast of STDP by Dopaminergic Modulation at Hippocampal Synapses

Time-limited Modulation of Appetitive Pavlovian Memory by D1 and NMDA Receptors in the Nucleus Accumbens.

Dopamine-mediated interactions between short- and long-term memory dynamics

Perceptual Learning beyond Perception: Mnemonic Representation in Early Visual Cortex and Intraparietal Sulcus

Brief Change in Dopamine Activity during Consolidation Impairs Long-Term Memory via Sleep Disruption

Phasic dopamine release in the medial prefrontal cortex enhances stimulus discrimination

Reward learning and working memory: Effects of massed versus spaced training and post-learning delay period

Dopamine Regulates Aversive Contextual Learning and Associated In Vivo Synaptic Plasticity in the Hippocampus

Auditory discrimination and frequency modulation learning in schizophrenia patients: amphetamine within-subject dose response and time course

A silent eligibility trace enables dopamine‐dependent synaptic plasticity for reinforcement learning in the mouse striatum

Paradoxical Boosting of Weak and Strong Spatial Memories by Hippocampal Dopamine Uncaging

Dopamine and Consolidation of Episodic Memory: Timing is Everything

Auditory training remodels hippocampus-related memory in adult rats

Dopaminergic Modulation of Visual Attention and Working Memory in the Rodent Prefrontal Cortex