Abstract:Navigating the physical world requires learning probabilistic associations between sensory events and their change in time (volatility). Bayesian accounts of this learning process rest on hierarchical prediction errors (PEs) that are weighted by estimates of uncertainty (or its inverse, precision). In a previous fMRI study we found that low-level precision-weighted PEs about visual outcomes (that update beliefs about associations) activated the putative dopaminergic midbrain; by contrast, precision-weighted PEs about cue-outcome associations (that update beliefs about volatility) activated the cholinergic basal forebrain. These findings suggested selective dopaminergic and cholinergic influences on precision-weighted PEs at different hierarchical levels.Here, we tested this hypothesis, repeating our fMRI study under pharmacological manipulations in healthy participants. Specifically, we performed two pharmacological fMRI studies with a between-subject double-blind placebo-controlled design: study 1 used antagonists of dopaminergic (amisulpride) and muscarinic (biperiden) receptors, study 2 used enhancing drugs of dopaminergic (levodopa) and cholinergic (galantamine) modulation.Pooled across all pharmacological conditions of study 1 and study 2, respectively, we found that low-level precision-weighted PEs activated the midbrain and high-level precision-weighted PEs the basal forebrain as in our previous study. However, we found pharmacological effects on brain activity associated with these computational quantities only when splitting the precision-weighted PEs into their PE and precision components: in a brainstem region putatively containing cholinergic (pedunculopontine and laterodorsal tegmental) nuclei, biperiden (compared to placebo) enhanced low-level PE responses and attenuated high-level PE activity, while amisulpride reduced high-level PE responses. Additionally, in the putative dopaminergic midbrain, galantamine compared to placebo enhanced low-level PE responses (in a body-weight dependent manner) and amisulpride enhanced high-level precision activity. Task behaviour was not affected by any of the drugs.These results do not support our hypothesis of a clear-cut dichotomy between different hierarchical inference levels and neurotransmitter systems, but suggest a more complex interaction between these neuromodulatory systems and hierarchical Bayesian quantities. However, our present results may have been affected by confounds inherent to pharmacological fMRI. We discuss these confounds and outline improved experimental tests for the future.

Prediction Error During Retrospective Revaluation of Causal Associations in Humans: Fmri Evidence in Favor of an Associative Model of Learning

The Role of the Lateral Frontal Cortex in Causal Associative Learning: Exploring Preventative and Super-Learning.

Differential Neural Correlates Underlie Judgment of Learning and Subsequent Memory Performance

Defining the Neural Mechanisms of Probabilistic Reversal Learning Using Event-Related Functional Magnetic Resonance Imaging

Dopamine release in human associative striatum during reversal learning

Beyond Reward Prediction Errors: Human Striatum Updates Rule Values During Learning

Building and Breaking the Chain: A Model of Reward Prediction Error Integration and Segmentation of Memory

Temporal dynamics of competition between statistical learning and episodic memory in intracranial recordings of human visual cortex

The Dopamine Prediction Error: Contributions to Associative Models of Reward Learning

Neural correlates of rapid reversal learning in a simple model of human social interaction.

Meta-analysis of human prediction error for incentives, perception, cognition, and action

Disrupted Prediction-Error Signal in Psychosis: Evidence for an Associative Account of Delusions.

Neural Substrates of Updating the Prediction Through Prediction Error During Decision Making.

Temporal Prediction Errors Modulate Cingulate–insular Coupling

Learning from imagined experiences via an endogenous prediction error

Surprise! Neural Correlates of Pearce–Hall and Rescorla–Wagner Coexist Within the Brain

Cholinergic and dopaminergic effects on prediction error and uncertainty responses during sensory associative learning

Contrasting Cortical and Subcortical Activations Produced by Attentional-Set Shifting and Reversal Learning in Humans

Stimulus-dependent adjustment of reward prediction error in the midbrain

Reactivation of reward representations associated with the reinforcement of behavior