Abstract:<p>This article aims to provide a synthesis on the question how brain structures cooperate to accomplish hierarchically organized behaviors, characterized by low‐level, habitual routines nested in larger sequences of planned, goal‐directed behavior. The functioning of a connected set of brain structures—prefrontal cortex, hippocampus, striatum, and dopaminergic mesencephalon—is reviewed in relation to two important distinctions: (a) goal‐directed as opposed to habitual behavior and (b) model‐based and model‐free learning. Recent evidence indicates that the orbitomedial prefrontal cortices not only subserve goal‐directed behavior and model‐based learning, but also code the "landscape" (task space) of behaviorally relevant variables. While the hippocampus stands out for its role in coding and memorizing world state representations, it is argued to function in model‐based learning but is not required for coding of action–outcome contingencies, illustrating that goal‐directed behavior is not congruent with model‐based learning. While the dorsolateral and dorsomedial striatum largely conform to the dichotomy between habitual versus goal‐directed behavior, ventral striatal functions go beyond this distinction. Next, we contextualize findings on coding of reward‐prediction errors by ventral tegmental dopamine neurons to suggest a broader role of mesencephalic dopamine cells, viz. in behavioral reactivity and signaling unexpected sensory changes. We hypothesize that goal‐directed behavior is hierarchically organized in interconnected cortico‐basal ganglia loops, where a limbic‐affective prefrontal‐ventral striatal loop controls action selection in a dorsomedial prefrontal–striatal loop, which in turn regulates activity in sensorimotor‐dorsolateral striatal circuits. This structure for behavioral organization requires alignment with mechanisms for memory formation and consolidation. We propose that frontal corticothalamic circuits form a high‐level loop for memory processing that initiates and temporally organizes nested activities in lower‐level loops, including the hippocampus and the ripple‐associated replay it generates. The evidence on hierarchically organized behavior converges with that on consolidation mechanisms in suggesting a frontal‐to‐caudal directionality in processing control.</p>

Behavioral state regulates the dynamics of memory consolidation

Early excitatory-inhibitory cortical modifications following skill learning are associated with motor memory consolidation and plasticity overnight

Memory consolidation of sequence learning and dynamic adaptation during wakefulness

Changes in patterns of neural activity underlie a time-dependent transformation of memory in rats and humans

Synaptic weight dynamics underlying memory consolidation: implications for learning rules, circuit organization, and circuit function

Cerebellar systems consolidation driven by the temporal dynamics of Purkinje cell excitability

Expression of a Form of Cerebellar Motor Memory Requires Learned Alterations to the Activity of Inhibitory Molecular Layer Interneurons

Brief Change in Dopamine Activity during Consolidation Impairs Long-Term Memory via Sleep Disruption

Rapid Formation and Selective Stabilization of Synapses for Enduring Motor Memories

Selective consolidation of learning and memory via recall-gated plasticity

Dynamic alteration of intrinsic properties of the cerebellar Purkinje cell during the motor memory consolidation

The persistence of memory: prior memory responses modulate behavior and brain state engagement

Multiple Functions of Cerebello-Thalamic Neurons in Learning and Offline Consolidation of a Motor Skill in mice

Cerebellar motor memory expression requires learned alterations to the activity of inhibitory molecular layer interneurons

Temporal cluster-based organization of sleep spindles underlies motor memory consolidation

Conserved Population Dynamics in the Cerebro-Cerebellar System between Waking and Sleep

Membrane potential states gate synaptic consolidation in human neocortical tissue

Divergent recruitment of developmentally defined neuronal ensembles supports memory dynamics

Synaptic Mechanisms of Memory Consolidation during Sleep Slow Oscillations

Learning, memory and consolidation mechanisms for behavioral control in hierarchically organized cortico‐basal ganglia systems