Abstract:Only recently have the functional implications of the organization of the ventral striatum, amygdala, and related limbic-cortical structures, and their neuroanatomical interactions begun to be clarified. Processes of activation and reward have long been associated with the NAcc and its dopamine innervation, but the precise relationships between these constructs have remained elusive. We have sought to enrich our understanding of the special role of the ventral striatum in coordinating the contribution of different functional subsystems to confer flexibility, as well as coherence and vigor, to goal-directed behavior, through different forms of associative learning. Such appetitive behavior comprises many subcomponents, some of which we have isolated in these experiments to reveal that, not surprisingly, the mechanisms by which an animal sequences responding to reach a goal are complex. The data reveal how the different components, pavlovian approach (or sign-tracking), conditioned reinforcement (whereby pavlovian stimuli control goal-directed action), and also more general response-invigorating processes (often called "activation," "stress," or "drive") may be integrated within the ventral striatum through convergent interactions of the amygdala, other limbic cortical structures, and the mesolimbic dopamine system to produce coherent behavior. The position is probably not far different when considering aversively motivated behavior. Although it may be necessary to employ simplified, even abstract, paradigms for isolating these mechanisms, their concerted action can readily be appreciated in an adaptive, functional setting, such as the responding by rats for intravenous cocaine under a second-order schedule of reinforcement. Here, the interactions of primary reinforcement, psychomotor activation, pavlovian conditioning, and the control that drug cues exert over the integrated drug-seeking response can be seen to operate both serially and concurrently. The power of our analytic techniques for understanding complex motivated behavior has been evident for some time. However, the crucial point is that we are now able to map these components with increasing certainty onto discrete amygdaloid, and other limbic cortical-ventral striatal subsystems. The neural dissection of these mechanisms also serves an important theoretical purpose in helping to validate the various hypothetical constructs and further developing theory. Major challenges remain, not the least of which is an understanding of the operation of the ventral striatum together with its dopaminergic innervation and its interactions with the basolateral amygdala, hippocampal formation, and prefrontal cortex at a more mechanistic, neuronal level.

Ventral frontostriatal circuitry mediates the computation of reinforcement from symbolic gains and losses

Computational mechanisms underlying motivation to earn symbolic reinforcers

An opponent striatal circuit for distributional reinforcement learning

Prefrontal cortex as a meta-reinforcement learning system

Associative Processes in Addiction and Reward the Role of Amygdala‐Ventral Striatal Subsystems

Dissociable representations of decision variables within subdivisions of macaque orbitofrontal and ventrolateral frontal cortex

Associative Processes in Addiction and Reward The Role of Amygdala-Ventral Striatal Subsystems

Dissociable Representations of Decision Variables within Subdivisions of the Macaque Orbital and Ventrolateral Frontal Cortex

Meta-reinforcement learning via orbitofrontal cortex

Ventrolateral prefrontal cortex in macaques guides decisions in different learning contexts

The ventral striato-pallidal pathway mediates the effect of predictive learning on choice between goal-directed actions

A ventral pallidal-thalamocortical circuit mediates the cognitive control of instrumental action

Frontal Cortex and Reward-Guided Learning and Decision-Making

Dissociable Functions of Reward Inference in the Lateral Prefrontal Cortex and the Striatum

Encoding Motivation Prediction Errors in the Human Dopaminergic Reward System

Human dorsal striatal activity during choice discriminates reinforcement learning behavior from the gambler's fallacy

Ventral tegmental area dopamine neural activity switches simultaneously with rule representations in the prefrontal cortex and hippocampus

Believing in dopamine

Distinct dynamics and intrinsic properties in ventral tegmental area populations mediate reward association and motivation

Orbitofrontal Cortex Mediates Sustained Basolateral Amygdala Encoding of Cued Reward-Seeking States

Direct Pathway Neurons in the Mouse Ventral Striatum Are Active During Goal-Directed Action but Not Reward Consumption During Operant Conditioning