Abstract:Learning to optimally predict rewards requires agents to account for fluctuations in reward value. Recent work suggests that individuals can efficiently learn about variable rewards through adaptation of the learning rate, and coding of prediction errors relative to reward variability. Such adaptive coding has been linked to midbrain dopamine neurons in nonhuman primates, and evidence in support for a similar role of the dopaminergic system in humans is emerging from fMRI data. Here, we sought to investigate the effect of dopaminergic perturbations on adaptive prediction error coding in humans, using a between-subject, placebo-controlled pharmacological fMRI study with a dopaminergic agonist (bromocriptine) and antagonist (sulpiride). Participants performed a previously validated task in which they predicted the magnitude of upcoming rewards drawn from distributions with varying SDs. After each prediction, participants received a reward, yielding trial-by-trial prediction errors. Under placebo, we replicated previous observations of adaptive coding in the midbrain and ventral striatum. Treatment with sulpiride attenuated adaptive coding in both midbrain and ventral striatum, and was associated with a decrease in performance, whereas bromocriptine did not have a significant impact. Although we observed no differential effect of SD on performance between the groups, computational modeling suggested decreased behavioral adaptation in the sulpiride group. These results suggest that normal dopaminergic function is critical for adaptive prediction error coding, a key property of the brain thought to facilitate efficient learning in variable environments. Crucially, these results also offer potential insights for understanding the impact of disrupted dopamine function in mental illness.SIGNIFICANCE STATEMENT To choose optimally, we have to learn what to expect. Humans dampen learning when there is a great deal of variability in reward outcome, and two brain regions that are modulated by the brain chemical dopamine are sensitive to reward variability. Here, we aimed to directly relate dopamine to learning about variable rewards, and the neural encoding of associated teaching signals. We perturbed dopamine in healthy individuals using dopaminergic medication and asked them to predict variable rewards while we made brain scans. Dopamine perturbations impaired learning and the neural encoding of reward variability, thus establishing a direct link between dopamine and adaptation to reward variability. These results aid our understanding of clinical conditions associated with dopaminergic dysfunction, such as psychosis.

Methamphetamine-induced Disruption of Frontostriatal Reward Learning Signals: Relation to Psychotic Symptoms.

N-Acetyl and Glutamatergic Neurometabolites in Perisylvian Brain Regions of Methamphetamine Users

Substantia Nigra/Ventral Tegmental Reward Prediction Error Disruption in Psychosis

Methamphetamine Activates Reward Circuitry in Drug Naïve Human Subjects

Extinction-Dependent Alterations in Corticostriatal mGluR2/3 and mGluR7 Receptors following Chronic Methamphetamine Self-Administration in Rats

Metabolites Alterations in the Medial Prefrontal Cortex of Methamphetamine Users in Abstinence: A 1H MRS Study

Abnormal Reward Prediction-Error Signalling in Antipsychotic Naive Individuals with First-Episode Psychosis or Clinical Risk for Psychosis

Low Striatal Dopamine D2-type Receptor Availability is Linked to Simulated Drug Choice in Methamphetamine Users

The Distinct Roles of Various Neurotransmitters in Modulating Methamphetamine-Induced Conditioned Place Preference in Relevant Brain Regions in Mice

Brain Dysfunction Of Methamphetamine-Associated Psychosis In Resting State: Approaching Schizophrenia And Critical Role Of Right Superior Temporal Deficit

Compulsive Drug-Taking is Associated with Habenula–frontal Cortex Connectivity

Amphetamine use disorder is associated with striatum hypoactivation during anticipation of loss and reward

Effects of familial risk and stimulant drug use on the anticipation of monetary reward: an fMRI study

Low Dopamine D2/D3 Receptor Availability is Associated with Steep Discounting of Delayed Rewards in Methamphetamine Dependence

The Prefrontal Cortex to the Hippocampus Glutamatergic Pathway Regulates Reward Effects of Methamphetamine

Methamphetamine Abuse Impairs Motor Cortical Plasticity and Function

Reduced brain connectivity underlying value-based choices and outcomes in stimulant use disorder

Dysfunctional feedback processing in male methamphetamine abusers: Evidence from neurophysiological and computational approaches

Reward disturbances in antipsychotic-naïve patients with first-episode psychosis and their association to glutamate levels

Dopamine Modulates Adaptive Prediction Error Coding in the Human Midbrain and Striatum

Abnormal striatal circuitry and intensified novelty seeking among adolescents who abuse methamphetamine and cannabis