Abstract:Highlights • Dopamine release in dorsomedial striatum tracks learning, movement and motivation. • Bilateral dopamine release at the time of reward reflects the current action value. • Bilateral dopamine release at the time of reward reflects the prediction error. • Dopamine release becomes increasingly lateralized during goal-directed learning. • Dopamine laterization reflects the strength of the action-outcome association. Evidence suggests that dopamine activity provides a US-related prediction error for Pavlovian conditioning and the reinforcement signal supporting the acquisition of habits. However, its role in goal-directed action is less clear. There are currently few studies that have assessed dopamine release as animals acquire and perform self-paced instrumental actions. Here we briefly review the literature documenting the psychological, behavioral and neural bases of goal-directed actions in rats and mice, before turning to describe recent studies investigating the role of dopamine in instrumental learning and performance. Plasticity in dorsomedial striatum, a central node in the network supporting goal-directed action, clearly requires dopamine release, the timing of which, relative to cortical and thalamic inputs, determines the degree and form of that plasticity. Beyond this, bilateral release appears to reflect reward prediction errors as animals experience the consequences of an action. Such signals feedforward to update the value of the specific action associated with that outcome during subsequent performance, with dopamine release at the time of action reflecting the updated predicted action value. More recently, evidence has also emerged for a hemispherically lateralised signal associated with the action; dopamine release is greater in the hemisphere contralateral to the spatial target of the action. This effect emerges over the course of acquisition and appears to reflect the strength of the action-outcome association. Thus, during goal-directed action, dopamine release signals the action, the outcome and their association to shape the learning and performance processes necessary to support this form of behavioral control.

Striatal dopamine signals reflect perceived cue–action–outcome associations in mice

Nigrostriatal Dopamine Signals Sequence-Specific Action-Outcome Prediction Errors

Dopamine Release Plateau and Outcome Signals in Dorsal Striatum Contrast with Classic Reinforcement Learning Formulations

Dopamine neurons drive spatiotemporally heterogeneous striatal dopamine signals during learning

Dopamine reveals adaptive learning of actions representation

Dopamine dynamics in nucleus accumbens across reward-based learning of goal-directed whisker-to-lick sensorimotor transformations in mice

Striatal dopamine reflects individual long-term learning trajectories

Mesostriatal dopamine is sensitive to changes in specific cue-reward contingencies

Reinforcement Learning Links Spontaneous Cortical Dopamine Impulses to Reward

A selective role for dopamine in stimulus-reward learning

The role of prospective contingency in the control of behavior and dopamine signals during associative learning

A causal link between prediction errors, dopamine neurons and learning

Dynamic shaping of dopamine signals during probabilistic Pavlovian conditioning

Action prediction error: a value-free dopaminergic teaching signal that drives stable learning

Neural activity ramps in frontal cortex signal extended motivation during learning

Direct Pathway Neurons in the Mouse Ventral Striatum Are Active During Goal-Directed Action but Not Reward Consumption During Operant Conditioning

Role of dopamine in reward expectation and predictability during execution of action sequences

Sensory Cues Potentiate VTA Dopamine Mediated Reinforcement

[Multiple Dopamine Signals and Their Contributions to Reinforcement Learning]

What role does striatal dopamine play in goal-directed action?

Valence ambiguity dynamically shapes striatal dopamine heterogeneity