Abstract:Organisms learn to gain reward and avoid punishment through action–outcome associations. Reinforcement learning (RL) offers a critical framework to understand individual differences in this associative learning by assessing learning rate, action bias, pavlovian factor (i.e., the extent to which action values are influenced by stimulus values), and subjective impact of outcomes (i.e., motivation to seek reward and avoid punishment). Nevertheless, how these individual-level metrics are represented in the brain remains unclear. The current study leveraged fMRI in healthy humans and a probabilistic learning go/no-go task to characterize the neural correlates involved in learning to seek reward and avoid pain. Behaviorally, participants showed a higher learning rate during pain avoidance relative to reward seeking. Additionally, the subjective impact of outcomes was greater for reward trials and associated with lower response randomness. Our imaging findings showed that individual differences in learning rate and performance accuracy during avoidance learning were positively associated with activities of the dorsal anterior cingulate cortex, midcingulate cortex, and postcentral gyrus. In contrast, the pavlovian factor was represented in the precentral gyrus and superior frontal gyrus (SFG) during pain avoidance and reward seeking, respectively. Individual variation of the subjective impact of outcomes was positively predicted by activation of the left posterior cingulate cortex. Finally, action bias was represented by the supplementary motor area (SMA) and pre-SMA whereas the SFG played a role in restraining this action tendency. Together, these findings highlight for the first time the neural substrates of individual differences in the computational processes during RL.

The role of the thalamus in human reinforcement learning

Beyond Auditory Relay: Dissecting the Inferior Colliculus’s Role in Sensory Prediction, Cognitive Decision-Making, and Reward Prediction

Short-term Memory Traces for Action Bias in Human Reinforcement Learning

Reactivation of reward representations associated with the reinforcement of behavior

Neural interactions in the human frontal cortex dissociate reward and punishment learning

Subsecond fluctuations in extracellular dopamine encode reward and punishment prediction errors in humans

Thalamic Regulation of Frontal Interactions in Human Cognitive Flexibility

Network state changes in sensory thalamus represent learned outcomes.

The Role of the Striatum in Aversive Learning and Aversive Prediction Errors

Reward Recalibrates Rule Representations in Human Amygdala and Hippocampus Intracranial Recordings

A ventral pallidal-thalamocortical circuit mediates the cognitive control of instrumental action

Role of Dopamine D2 Receptors in Human Reinforcement Learning.

Encoding of predictive associations in human prefrontal and medial temporal neurons during Pavlovian appetitive conditioning

The thalamus encodes and updates context representations during hierarchical cognitive control

Differential Roles of Human Striatum and Amygdala in Associative Learning

Neural correlates of sensorimotor adaptation: thalamic contributions to learning from sensory prediction error

Role of Posterior Medial Thalamus in the Modulation of Striatal Circuitry and Choice Behavior

How cortico-basal ganglia-thalamic subnetworks can shift decision policies to maximize reward rate

Distinct roles of two thalamostriatal systems in learning processes of visual discrimination in common marmosets

The Neural Correlates of Individual Differences in Reinforcement Learning during Pain Avoidance and Reward Seeking

Ventral frontostriatal circuitry mediates the computation of reinforcement from symbolic gains and losses