Abstract:Navigating the physical world requires learning probabilistic associations between sensory events and their change in time (volatility). Bayesian accounts of this learning process rest on hierarchical prediction errors (PEs) that are weighted by estimates of uncertainty (or its inverse, precision). In a previous fMRI study we found that low-level precision-weighted PEs about visual outcomes (that update beliefs about associations) activated the putative dopaminergic midbrain; by contrast, precision-weighted PEs about cue-outcome associations (that update beliefs about volatility) activated the cholinergic basal forebrain. These findings suggested selective dopaminergic and cholinergic influences on precision-weighted PEs at different hierarchical levels.Here, we tested this hypothesis, repeating our fMRI study under pharmacological manipulations in healthy participants. Specifically, we performed two pharmacological fMRI studies with a between-subject double-blind placebo-controlled design: study 1 used antagonists of dopaminergic (amisulpride) and muscarinic (biperiden) receptors, study 2 used enhancing drugs of dopaminergic (levodopa) and cholinergic (galantamine) modulation.Pooled across all pharmacological conditions of study 1 and study 2, respectively, we found that low-level precision-weighted PEs activated the midbrain and high-level precision-weighted PEs the basal forebrain as in our previous study. However, we found pharmacological effects on brain activity associated with these computational quantities only when splitting the precision-weighted PEs into their PE and precision components: in a brainstem region putatively containing cholinergic (pedunculopontine and laterodorsal tegmental) nuclei, biperiden (compared to placebo) enhanced low-level PE responses and attenuated high-level PE activity, while amisulpride reduced high-level PE responses. Additionally, in the putative dopaminergic midbrain, galantamine compared to placebo enhanced low-level PE responses (in a body-weight dependent manner) and amisulpride enhanced high-level precision activity. Task behaviour was not affected by any of the drugs.These results do not support our hypothesis of a clear-cut dichotomy between different hierarchical inference levels and neurotransmitter systems, but suggest a more complex interaction between these neuromodulatory systems and hierarchical Bayesian quantities. However, our present results may have been affected by confounds inherent to pharmacological fMRI. We discuss these confounds and outline improved experimental tests for the future.

Model-based and model-free leaning by striatal neurons

Bayesian modelling of visual discrimination learning in mice

Striatal dopamine reflects individual long-term learning trajectories

Sperry versus Hebb: Topographic mapping in Isl2/EphA3 mutant mice

Hierarchy of prediction errors shapes the learning of context-dependent sensory representations

Regulation of Learning by EphA Receptors: a Protein Targeting Study

A Neural Model of the Frontal Eye Fields with Reward-Based Learning.

Unsigned temporal difference errors in cortical L5 dendrites during learning

Entorhinal cortex directs learning-related changes in CA1 representations

Evolving Models of Pavlovian Conditioning: Cerebellar Cortical Dynamics in Awake Behaving Mice

Learning strategy selection in the water maze and hippocampal CREB phosphorylation differ in two inbred strains of mice

Enhanced cognitive flexibility and phasic striatal dopamine dynamics in a mouse model of low striatal tonic dopamine

Cell Type-Specific Membrane Potential Changes in Dorsolateral Striatum Accompanying Reward-Based Sensorimotor Learning

Learning Alters Theta Amplitude, Theta-Gamma Coupling and Neuronal Synchronization in Inferotemporal Cortex

A Mouse Model of Visual Perceptual Learning Reveals Alterations in Neuronal Coding and Dendritic Spine Density in the Visual Cortex

Medium spiny neurons of the anterior dorsomedial striatum mediate reversal learning in a cell-type-dependent manner

Cholinergic and dopaminergic effects on prediction error and uncertainty responses during sensory associative learning

Mesencephalic projections to the nucleus accumbens shell modulate value updating during probabilistic reversal learning

Sensory History Drives Adaptive Neural Geometry in LP/Pulvinar-Prefrontal Cortex Circuits

Model-based reward prediction in the primate prefrontal cortex

Orbital frontal cortex updates state-induced value change for decision-making