Abstract:Reward-associated cues serve different functions depending on whether they precede or terminate action sequences. Cues that precede action sequences and signal opportunity for reward could serve as GO signals to initiate the sequence, whereas sequence termination cues could serve as response feedback by signaling reward delivery. Reward expectation during sequence execution depends on these cues and might condition whether behavior is habitual or goal-directed. However, it remains unknown how sequence initiation and termination cues differentially affect reward expectation and contribute to habit learning. Further, while mesolimbic dopamine plays a key role in cue-induced reward expectation and sequence learning, how dynamic changes in dopamine signals differ depending on the response strategy is unclear. Here, we determined how mesolimbic DA signals change over training during cue-mediated sequence learning, depending on the type of cue and the nature of behavioral control. We found sequence initiation and termination cues differentially affect reward expectation during action sequences, with the termination cue contributing to habit and automaticity. Distinct response strategies induced by sequence initiation and termination cues induced differential changes in mesolimbic DA signals that captured variations in reward expectation along sequence execution. Notably, habit-like behavior induced by the sequence termination cue was associated with a rapid shift in DA signals from reward retrieval to the cue. This habit-like behavior was reflected in behavioral inflexibility and attenuated DA reward prediction error signals. Finally, using optogenetics, we provide evidence that phasic DA activity elicited by the sequence termination cue is critical for the development of habit-like behavior.

Dopamine dynamics are dispensable for movement but promote reward responses

Slowly Evolving Dopaminergic Activity Modulates the Moment-to-moment Probability of Reward-Related Self-Timed Movements

Dopamine–endocannabinoid Interactions Mediate Spike-Timing-dependent Potentiation in the Striatum

A mismatch between striatal cholinergic pauses and dopaminergic reward prediction errors

Cellular Responses to Psychomotor Stimulant and Neuroleptic Drugs Are Abnormal in Mice Lacking the D1 Dopamine Receptor

Dopamine D1 Receptor Mutant Mice Are Deficient in Striatal Expression of Dynorphin and in Dopamine-Mediated Behavioral Responses

Dynamic Nigrostriatal Dopamine Biases Action Selection.

Intrinsic dopamine and acetylcholine dynamics in the striatum of mice

Enhanced cognitive flexibility and phasic striatal dopamine dynamics in a mouse model of low striatal tonic dopamine

Reinforcement Learning Links Spontaneous Cortical Dopamine Impulses to Reward

Nigrostriatal Dopamine Signals Sequence-Specific Action-Outcome Prediction Errors

Does phasic dopamine release cause policy updates?

Dopamine dynamics in nucleus accumbens across reward-based learning of goal-directed whisker-to-lick sensorimotor transformations in mice

Acetylcholine demixes heterogeneous dopamine signals for learning and moving

Role of dopamine in reward expectation and predictability during execution of action sequences

Elimination of Cocaine-Induced Hyperactivity and Dopamine-Mediated Neurophysiological Effects in Dopamine D1 Receptor Mutant Mice

An Action Potential Initiation Mechanism in Distal Axons for the Control of Dopamine Release

Dopamine, learning and motivation

Pharmacological modulation of dopamine D1 and D2 receptors reveals distinct neural networks related to probabilistic learning in non-human primates.

Dynamic rewiring of neural circuits in the motor cortex in mouse models of Parkinson's disease

Intrinsic Reward-Like Dopamine and Acetylcholine Dynamics in Striatum