Abstract:Cognitive flexibility, the capacity to adapt behaviour to changes in the environment, is impaired in a range of brain disorders, including substance use disorder and Parkinson’s disease. Putative neural substrates of cognitive flexibility include mesencephalic pathways to the ventral striatum (VS) and dorsomedial striatum (DMS), hypothesised to encode learning signals needed to maximize rewarded outcomes during decision-making. However, it is unclear whether mesencephalic projections to the ventral and dorsal striatum are distinct in their contribution to flexible reward-related learning. Here, rats acquired a two-choice spatial probabilistic reversal learning (PRL) task, reinforced on an 80%:20% basis, that assessed the flexibility of behaviour to repeated reversals of response-outcome contingencies. We report that optogenetic stimulation of projections from the ventral tegmental area (VTA) to the nucleus accumbens shell (NAcbS) in the VS significantly impaired reversal learning when optical stimulation was temporally aligned with negative feedback (i.e., reward omission). Moreover, the exploitation-exploration parameter, , was increased (indicating greater exploitation of information) when this pathway was optogenetically stimulated after a spurious loss (i.e. an incorrect (20%) response at the 80% reinforrced location) compared to after a spurious win (i.e. a correct (20%) response at the 20% reinforced location). VTA → NAcbS stimulation during other phases of the behavioural task was without effect. Optogenetic stimulation of projection neurons from the substantia nigra (SN) to the DMS, aligned either with reward receipt or omission or prior to making a choice, had no effect on reversal learning. These findings are consistent with the notion that enhanced activity in VTA → NAcbS projections leads to maladaptive perseveration as a consequence of an inappropriate bias to exploitation positive reinforcement.

Medium spiny neurons of the anterior dorsomedial striatum mediate reversal learning in a cell-type-dependent manner

Characterization of Striatal Dopamine Projections Across Striatal Subregions in Behavioral Flexibility

Dorsal and Ventral Striatal Dopamine D1 and D2 Receptors Differentially Modulate Distinct Phases of Serial Visual Reversal Learning.

Optogenetic activation of mesencephalic projections to the nucleus accumbens shell impairs probabilistic reversal learning by disrupting learning from negative reinforcement

Mesencephalic projections to the nucleus accumbens shell modulate value updating during probabilistic reversal learning

Cholinergic Neurons in the Pedunculopontine Nucleus Guide Reversal Learning by Signaling the Changing Reward Contingency.

Drug reinforcement impairs cognitive flexibility by inhibiting striatal cholinergic neurons

Dynamic regulation of corticostriatal glutamatergic synaptic expression during reversal learning in male mice

Dorsolateral Striatal proBDNF Improves Reversal Learning by Enhancing Coordination of Neural Activity in Rats

Striatum Expresses Region-Specific Plasticity Consistent with Distinct Memory Abilities

Selective Lesions of the Dorsomedial Striatum Impair Serial Spatial Reversal Learning in Rats

Dissociable Contributions of Basolateral Amygdala and Ventrolateral Orbitofrontal Cortex to Flexible Learning Under Uncertainty

NMDA receptor dependence of reversal learning and the flexible use of cognitively demanding search strategies in mice

D2 Receptors and Cognitive Flexibility in Marmosets: Tri-Phasic Dose–response Effects of Intra-Striatal Quinpirole on Serial Reversal Performance

Enhanced cognitive flexibility and phasic striatal dopamine dynamics in a mouse model of low striatal tonic dopamine

Lesions of the Medial Striatum in Monkeys Produce Perseverative Impairments During Reversal Learning Similar to Those Produced by Lesions of the Orbitofrontal Cortex

Involvement of Midbrain Dopamine Neuron Activity in Negative Reinforcement Learning in Mice.

Nucleus accumbens medium spiny neurons subtypes signal both reward and aversion

Spatially organized striatum-wide acetylcholine dynamics for the learning and extinction of Pavlovian cues and actions

Cell-type-specific striatal modulation of amygdalar acetylcholine in salience assignment

Dopamine D2-like Receptor Stimulation Blocks Negative Feedback in Visual and Spatial Reversal Learning in the Rat: Behavioural and Computational Evidence