Abstract:In dynamic environments, animals make behavioral decisions based on the innate valences of sensory cues and information learnt about these cues across multiple timescales 1–3 . However, it remains unclear how the innate valence of a sensory stimulus affects acquisition of learnt valence information and subsequent memory dynamics. Here we show that in the Drosophila brain, interconnected short- and long-term memory units of the mushroom body jointly regulate memory via dopamine signals that encode innate and learnt sensory valences. Through time-lapse, in vivo voltage-imaging studies of neural spiking in >500 flies undergoing olfactory associative conditioning, we found that protocerebral posterior lateral 1 dopamine neurons (PPL1-DANs) 4 heterogeneously and bi-directionally encode innate and learnt valences of punishment, reward, and odor cues. During learning, these valence signals regulate memory storage and extinction in mushroom body output neurons (MBONs) 5 . In initial conditioning bouts, PPL1-γ1pedc and PPL1-γ2α'1 neurons control short-term memory formation, which weakens inhibitory feedback from MBON-γ1pedc>α/β to PPL1-α'2α2 and PPL1-α3. During further conditioning, this diminished feedback allows these two PPL1-DANs to encode the net innate plus learnt valence of the conditioned odor cue, which gates long-term memory formation. A computational model constrained by the fly connectome 6,7 and our spiking data explains how dopamine signals mediate the circuit interactions between short- and long-term memory traces, yielding predictions that our experiments confirm. Overall, the mushroom body achieves flexible learning via the integration of innate and learnt valences within parallel learning units sharing feedback interconnections. This hybrid physiologic-anatomic mechanism may be a general means by which dopamine regulates memory dynamics in other species and brain structures, including the vertebrate basal ganglia.

Striatal dopamine reflects individual long-term learning trajectories

Pre-existing visual responses in a projection-defined dopamine population explain individual learning trajectories

Dopamine neurons drive spatiotemporally heterogeneous striatal dopamine signals during learning

Dopamine reveals adaptive learning of actions representation

Striatal dopamine signals reflect perceived cue–action–outcome associations in mice

Mesolimbic dopamine adapts the rate of learning from action

Temporal regularities shape perceptual decisions and striatal dopamine signals

Dopamine Release Plateau and Outcome Signals in Dorsal Striatum Contrast with Classic Reinforcement Learning Formulations

Spatially organized striatal neuromodulator release encodes trajectory errors

Coding Dynamics of the Striatal Networks During Learning

Goal-Directed Learning is Multidimensional and Accompanied by Diverse and Widespread Changes in Neocortical Signaling

Striatum Expresses Region-Specific Plasticity Consistent with Distinct Memory Abilities

Vector-valued dopamine improves learning of continuous outputs in the striatum

Dopamine release in human associative striatum during reversal learning

Behavioral encoding across timescales by region-specific dopamine dynamics

Mesolimbic dopamine encodes reward prediction errors independent of learning rates

A dopamine-dependent decrease in dorsomedial striatum direct pathway neuronal activity is required for learned motor coordination

Dopamine transients follow a striatal gradient of reward time horizons

Dopamine-mediated interactions between short- and long-term memory dynamics

Striatal dopamine contributions to skilled motor learning

Dopamine transients encode reward prediction errors independent of learning rates