Abstract:Highlights • Dopamine release in dorsomedial striatum tracks learning, movement and motivation. • Bilateral dopamine release at the time of reward reflects the current action value. • Bilateral dopamine release at the time of reward reflects the prediction error. • Dopamine release becomes increasingly lateralized during goal-directed learning. • Dopamine laterization reflects the strength of the action-outcome association. Evidence suggests that dopamine activity provides a US-related prediction error for Pavlovian conditioning and the reinforcement signal supporting the acquisition of habits. However, its role in goal-directed action is less clear. There are currently few studies that have assessed dopamine release as animals acquire and perform self-paced instrumental actions. Here we briefly review the literature documenting the psychological, behavioral and neural bases of goal-directed actions in rats and mice, before turning to describe recent studies investigating the role of dopamine in instrumental learning and performance. Plasticity in dorsomedial striatum, a central node in the network supporting goal-directed action, clearly requires dopamine release, the timing of which, relative to cortical and thalamic inputs, determines the degree and form of that plasticity. Beyond this, bilateral release appears to reflect reward prediction errors as animals experience the consequences of an action. Such signals feedforward to update the value of the specific action associated with that outcome during subsequent performance, with dopamine release at the time of action reflecting the updated predicted action value. More recently, evidence has also emerged for a hemispherically lateralised signal associated with the action; dopamine release is greater in the hemisphere contralateral to the spatial target of the action. This effect emerges over the course of acquisition and appears to reflect the strength of the action-outcome association. Thus, during goal-directed action, dopamine release signals the action, the outcome and their association to shape the learning and performance processes necessary to support this form of behavioral control.

Nigrostriatal Dopamine Signals Sequence-Specific Action-Outcome Prediction Errors

Dynamic Nigrostriatal Dopamine Biases Action Selection.

Role of dopamine in reward expectation and predictability during execution of action sequences

Action prediction error: a value-free dopaminergic teaching signal that drives stable learning

Striatal dopamine signals reflect perceived cue–action–outcome associations in mice

A causal link between prediction errors, dopamine neurons and learning

Dopamine Release Plateau and Outcome Signals in Dorsal Striatum Contrast with Classic Reinforcement Learning Formulations

Dopamine neurons drive spatiotemporally heterogeneous striatal dopamine signals during learning

A novel critic signal in identified midbrain dopaminergic neurons of mice training in operant tasks

Slowly Evolving Dopaminergic Activity Modulates the Moment-to-moment Probability of Reward-Related Self-Timed Movements

What role does striatal dopamine play in goal-directed action?

Dopaminergic prediction errors in the ventral tegmental area reflect a multithreaded predictive model

[Multiple Dopamine Signals and Their Contributions to Reinforcement Learning]

Dopamine reward prediction error signal codes the temporal evaluation of a perceptual decision report

Start/stop Signals Emerge in Nigrostriatal Circuits During Sequence Learning.

Nucleus accumbens and dorsal medial striatal dopamine and neural activity are essential for action sequence performance

Brief optogenetic inhibition of dopamine neurons mimics endogenous negative reward prediction errors

Rethinking dopamine‐guided action sequence learning

Dopamine, Prediction Error and Beyond

Subsecond dopamine fluctuations in human striatum encode superposed error signals about actual and counterfactual reward