Abstract:Only recently have the functional implications of the organization of the ventral striatum, amygdala, and related limbic-cortical structures, and their neuroanatomical interactions begun to be clarified. Processes of activation and reward have long been associated with the NAcc and its dopamine innervation, but the precise relationships between these constructs have remained elusive. We have sought to enrich our understanding of the special role of the ventral striatum in coordinating the contribution of different functional subsystems to confer flexibility, as well as coherence and vigor, to goal-directed behavior, through different forms of associative learning. Such appetitive behavior comprises many subcomponents, some of which we have isolated in these experiments to reveal that, not surprisingly, the mechanisms by which an animal sequences responding to reach a goal are complex. The data reveal how the different components, pavlovian approach (or sign-tracking), conditioned reinforcement (whereby pavlovian stimuli control goal-directed action), and also more general response-invigorating processes (often called "activation," "stress," or "drive") may be integrated within the ventral striatum through convergent interactions of the amygdala, other limbic cortical structures, and the mesolimbic dopamine system to produce coherent behavior. The position is probably not far different when considering aversively motivated behavior. Although it may be necessary to employ simplified, even abstract, paradigms for isolating these mechanisms, their concerted action can readily be appreciated in an adaptive, functional setting, such as the responding by rats for intravenous cocaine under a second-order schedule of reinforcement. Here, the interactions of primary reinforcement, psychomotor activation, pavlovian conditioning, and the control that drug cues exert over the integrated drug-seeking response can be seen to operate both serially and concurrently. The power of our analytic techniques for understanding complex motivated behavior has been evident for some time. However, the crucial point is that we are now able to map these components with increasing certainty onto discrete amygdaloid, and other limbic cortical-ventral striatal subsystems. The neural dissection of these mechanisms also serves an important theoretical purpose in helping to validate the various hypothetical constructs and further developing theory. Major challenges remain, not the least of which is an understanding of the operation of the ventral striatum together with its dopaminergic innervation and its interactions with the basolateral amygdala, hippocampal formation, and prefrontal cortex at a more mechanistic, neuronal level.

Mesencephalic projections to the nucleus accumbens shell modulate value updating during probabilistic reversal learning

Optogenetic activation of mesencephalic projections to the nucleus accumbens shell impairs probabilistic reversal learning by disrupting learning from negative reinforcement

Characterization of Striatal Dopamine Projections Across Striatal Subregions in Behavioral Flexibility

Dissociable Contributions of Basolateral Amygdala and Ventrolateral Orbitofrontal Cortex to Flexible Learning Under Uncertainty

Medium spiny neurons of the anterior dorsomedial striatum mediate reversal learning in a cell-type-dependent manner

Dorsal and Ventral Striatal Dopamine D1 and D2 Receptors Differentially Modulate Distinct Phases of Serial Visual Reversal Learning.

Reward and punishment contingency shifting reveals distinct roles for VTA dopamine and GABA neurons in behavioral flexibility

Valence ambiguity dynamically shapes striatal dopamine heterogeneity

Selective engagement of prefrontal VIP neurons in reversal learning

Selective Lesions of the Dorsomedial Striatum Impair Serial Spatial Reversal Learning in Rats

NMDA receptor dependence of reversal learning and the flexible use of cognitively demanding search strategies in mice

Valence-dependent dopaminergic modulation during reversal learning in Parkinson's disease: A neurocomputational approach

Dynamic regulation of corticostriatal glutamatergic synaptic expression during reversal learning in male mice

Nucleus Accumbens Dopamine Depletion Impairs Both Acquisition and Performance of Appetitive Pavlovian Approach Behaviour: Implications for Mesoaccumbens Dopamine Function

Glutamatergic and serotonergic modulation of rat medial and lateral orbitofrontal cortex in visual serial reversal learning.

Impaired flexible reward learning in ADHD patients is associated with blunted reinforcement sensitivity and neural signals in ventral striatum and parietal cortex

Dorsolateral Striatal proBDNF Improves Reversal Learning by Enhancing Coordination of Neural Activity in Rats

Lesions of the Medial Striatum in Monkeys Produce Perseverative Impairments During Reversal Learning Similar to Those Produced by Lesions of the Orbitofrontal Cortex

The ventral striato-pallidal pathway mediates the effect of predictive learning on choice between goal-directed actions

Dopamine D2-like Receptor Stimulation Blocks Negative Feedback in Visual and Spatial Reversal Learning in the Rat: Behavioural and Computational Evidence

Associative Processes in Addiction and Reward the Role of Amygdala‐Ventral Striatal Subsystems