Abstract:The synaptic and neuronal circuit mechanisms underlying reward-based learning remain to be fully determined. In the mammalian brain, dopamine release in nucleus accumbens is thought to contribute importantly to reward signals for learning and promoting synaptic plasticity. Here, through longitudinal fiber photometry of a genetically-encoded fluorescent sensor, we investigated dopamine signals in the nucleus accumbens of thirsty head-restrained mice as they learned to lick a liquid reward spout in response to single deflections of the C2 whisker across varying reward contingencies. Reward delivery triggered by well-timed licking drove fast transient dopamine increases in nucleus accumbens. On the other hand, unrewarded licking was overall associated with reduced dopamine sensor fluorescence, especially in trials where reward was unexpectedly omitted. The dopamine reward signal upon liquid delivery decreased within individual sessions as mice became sated. As mice learned to lick the reward spout in response to whisker deflection, a fast transient sensory-evoked dopamine signal developed, correlating with the learning of the whisker detection task across consecutive training days, as well as within single learning sessions. The well-defined behavioral paradigm involving a unitary stimulus of a single whisker as a reward-predicting cue along with precisely quantified licking allows untangling of sensory, motor and reward-related dopamine signals and how they evolve across the learning of whisker-dependent goal-directed sensorimotor transformations. Our longitudinal measurements of dopamine dynamics across reward-based learning are overall consistent with the hypothesis that dopamine could play an important role as a reward signal for reinforcement learning.

Directed motor actions and choice signalling drive cortical acetylcholine dynamics

Goal-directed motor actions drive acetylcholine dynamics in sensory cortex

Acetylcholine demixes heterogeneous dopamine signals for learning and moving

Cortical acetylcholine dynamics are predicted by cholinergic axon activity and behavior state

Spatiotemporally Heterogeneous Coordination of Cholinergic and Neocortical Activity

Visual stimulation drives retinotopic acetylcholine release in the mouse visual cortex

Spatially organized striatum-wide acetylcholine dynamics for the learning and extinction of Pavlovian cues and actions

Intrinsic dopamine and acetylcholine dynamics in the striatum of mice

Cortico-thalamic communication for action coordination in a skilled motor sequence

Dopamine dynamics in nucleus accumbens across reward-based learning of goal-directed whisker-to-lick sensorimotor transformations in mice

Frontal noradrenergic and cholinergic transients exhibit distinct spatiotemporal dynamics during competitive decision-making

The frontal cortex adjusts striatal integrator dynamics for flexible motor timing

Flow of Cortical Activity Underlying a Tactile Decision in Mice

Selective direct motor cortical influence during naturalistic climbing

Superior colliculus bidirectionally modulates choice activity in frontal cortex

Dynamics of directional motor tuning in the primate premotor and primary motor cortices during sensorimotor learning

Superior colliculus cell types bidirectionally modulate choice activity in frontal cortex

Flow of Information Underlying a Tactile Decision in Mice

Neural activity ramps in frontal cortex signal extended motivation during learning

Intrinsic Reward-Like Dopamine and Acetylcholine Dynamics in Striatum