Abstract:Navigating the physical world requires learning probabilistic associations between sensory events and their change in time (volatility). Bayesian accounts of this learning process rest on hierarchical prediction errors (PEs) that are weighted by estimates of uncertainty (or its inverse, precision). In a previous fMRI study we found that low-level precision-weighted PEs about visual outcomes (that update beliefs about associations) activated the putative dopaminergic midbrain; by contrast, precision-weighted PEs about cue-outcome associations (that update beliefs about volatility) activated the cholinergic basal forebrain. These findings suggested selective dopaminergic and cholinergic influences on precision-weighted PEs at different hierarchical levels.Here, we tested this hypothesis, repeating our fMRI study under pharmacological manipulations in healthy participants. Specifically, we performed two pharmacological fMRI studies with a between-subject double-blind placebo-controlled design: study 1 used antagonists of dopaminergic (amisulpride) and muscarinic (biperiden) receptors, study 2 used enhancing drugs of dopaminergic (levodopa) and cholinergic (galantamine) modulation.Pooled across all pharmacological conditions of study 1 and study 2, respectively, we found that low-level precision-weighted PEs activated the midbrain and high-level precision-weighted PEs the basal forebrain as in our previous study. However, we found pharmacological effects on brain activity associated with these computational quantities only when splitting the precision-weighted PEs into their PE and precision components: in a brainstem region putatively containing cholinergic (pedunculopontine and laterodorsal tegmental) nuclei, biperiden (compared to placebo) enhanced low-level PE responses and attenuated high-level PE activity, while amisulpride reduced high-level PE responses. Additionally, in the putative dopaminergic midbrain, galantamine compared to placebo enhanced low-level PE responses (in a body-weight dependent manner) and amisulpride enhanced high-level precision activity. Task behaviour was not affected by any of the drugs.These results do not support our hypothesis of a clear-cut dichotomy between different hierarchical inference levels and neurotransmitter systems, but suggest a more complex interaction between these neuromodulatory systems and hierarchical Bayesian quantities. However, our present results may have been affected by confounds inherent to pharmacological fMRI. We discuss these confounds and outline improved experimental tests for the future.

The role of uncertainty in regulating associative change.

Hey, What is Your Choice? Uncertainty and Inconsistency Enhance Subjective Anticipation of Upcoming Information in a Social Context

Cue Predictiveness and Uncertainty Determine Cue Representation During Visual Statistical Learning.

Anxious individuals are more sensitive to changes in outcome variability and value differences in dynamic environments

Uncertainty-modulated attentional capture: Outcome variance increases attentional priority.

Evidence for Different Roles of Inhibitory and Prospective Intolerance of Uncertainty During Threat Discrimination Learning

Further perceptions of probability: Accurate, stepwise updating is contingent on prior information about the task and the response mode

Uncertainty avoidance versus conditioned reinforcement: exploring paradoxical choice in rats

Uncertainty cues amplify late positive potential responses to aversive emotional stimuli

Controllability modulates the neural response to predictable but not unpredictable threat in humans

Signal detection analysis of contingency assessment: Associative interference and nonreinforcement impact cue-outcome contingency sensitivity, whereas cue density affects bias.

Distinct computational mechanisms of uncertainty processing explain opposing exploratory behaviors in anxiety and apathy

When stimulus variability accelerates the learning of task knowledge in adults and school-aged children

Flexible structure learning under uncertainty

Hope for the best when the result is uncertain: high uncertainty induces greater SPN amplitudes than low uncertainty

The interplay of contextual and immediate uncertainty: evidence for a common processing mechanism in prediction and cognitive control

Prediction error determines how memories are organized in the brain: a study of Pavlovian fear extinction in rats

The role of intolerance of uncertainty in classical threat conditioning: Recent developments and directions for future research

Learning of Uncertain Stimuli Transfers from Criterion-Based to Noise-Based Perceptual Decision, but Not Vice Versa

Prediction Error During Retrospective Revaluation of Causal Associations in Humans: Fmri Evidence in Favor of an Associative Model of Learning

Cholinergic and dopaminergic effects on prediction error and uncertainty responses during sensory associative learning