Dopamine neurons drive spatiotemporally heterogeneous striatal dopamine signals during learning

Liv Engel,Amy R Wolff,Madelyn Blake,Val L. Collins,Sonal Sinha,Benjamin T Saunders

DOI: https://doi.org/10.1101/2023.07.01.547331

2024-03-30

Abstract:Environmental cues, through Pavlovian learning, become conditioned stimuli that invigorate and guide animals toward acquisition of rewards. Dopamine neurons in the ventral tegmental area (VTA) and substantia nigra (SNC) are crucial for this process. Dopamine neurons are embedded in a reciprocally connected network with their striatal targets, the functional organization of which remains poorly understood. Here, we investigated how learning during optogenetic Pavlovian cue conditioning of VTA or SNC dopamine neurons directs cue-evoked behavior and shapes subregion-specific striatal dopamine dynamics. We used a fluorescent dopamine biosensor to monitor dopamine in the nucleus accumbens (NAc) core and shell, dorsomedial striatum (DMS), and dorsolateral striatum (DLS). We demonstrate spatially heterogeneous, learning-dependent dopamine changes across striatal regions. While VTA stimulation evoked robust dopamine release in NAc core, shell, and DMS, cues predictive of this activation preferentially recruited dopamine release in NAc core, starting early in training, and DMS, late in training. Corresponding negative prediction error signals, reflecting a violation in the expectation of dopamine neuron activation, only emerged in the NAc core and DMS, and not the shell. Despite development of vigorous movement late in training, conditioned dopamine signals did not similarly emerge in the DLS, even during Pavlovian conditioning with SNC dopamine neuron activation, which elicited robust DLS dopamine release. Together, our studies show broad dissociation in the fundamental prediction and reward-related information generated by different dopamine neuron populations and signaled by dopamine across the striatum. Further, they offer new insight into how larger-scale plasticity across the striatal network emerges during Pavlovian learning to coordinate behavior.

Neuroscience

What problem does this paper attempt to address?

This paper discusses the heterogeneity of dopamine signals driven by dopamine neurons in different regions of the striatum during the learning process. The study manipulated midbrain dopamine neurons using optogenetic methods and monitored dopamine transmission in different subregions of the striatum (such as the nucleus accumbens core, nucleus accumbens shell, dorsomedial striatum, and dorsolateral striatum) using fluorescent dopamine biosensors to understand how these neurons influence cue-triggered behavior and dopamine dynamics in conditioned learning. The study found that dopamine neuron activity is associated with specific behavioral responses, such as VTA activation leading to dopamine release in the nucleus accumbens (NAc) core, while cues predicting this activation recruit dopamine release mainly in the NAc core during early training and in the dorsomedial striatum (DMS) during late training. Negative prediction error signals, which indicate a violation of expected dopamine n

Dopamine neurons drive spatiotemporally heterogeneous striatal dopamine signals during learning

Superior colliculus projections drive dopamine neuron activity and movement but not value

Dynamic shaping of dopamine signals during probabilistic Pavlovian conditioning

A causal link between prediction errors, dopamine neurons and learning

Dopamine Release in the Nucleus Accumbens Core Encodes the General Excitatory Components of Learning

Dopamine Release Plateau and Outcome Signals in Dorsal Striatum Contrast with Classic Reinforcement Learning Formulations

Dopamine in the dorsal bed nucleus of stria terminalis signals Pavlovian sign-tracking and reward violations

Valence ambiguity dynamically shapes striatal dopamine heterogeneity

Distinct dynamics and intrinsic properties in ventral tegmental area populations mediate reward association and motivation

Nigrostriatal Dopamine Signals Sequence-Specific Action-Outcome Prediction Errors

Pre-existing visual responses in a projection-defined dopamine population explain individual learning trajectories

Direct Pathway Neurons in the Mouse Ventral Striatum Are Active During Goal-Directed Action but Not Reward Consumption During Operant Conditioning

Behavioral encoding across timescales by region-specific dopamine dynamics

Striatal dopamine reflects individual long-term learning trajectories

A novel critic signal in identified midbrain dopaminergic neurons of mice training in operant tasks

Striatal dopamine signals reflect perceived cue–action–outcome associations in mice

Dopamine release in the nucleus accumbens core signals perceived saliency

Sensory Cues Potentiate VTA Dopamine Mediated Reinforcement

[Multiple Dopamine Signals and Their Contributions to Reinforcement Learning]

Mesostriatal dopamine is sensitive to changes in specific cue-reward contingencies

Dopamine neuron ensembles signal the content of sensory prediction errors