Abstract:IMPORTANCE Major depressive disorder is prevalent and impairing. Parsing neurocomputational substrates of reinforcement learning in individuals with depression may facilitate a mechanistic understanding of the disorder and suggest new cognitive therapeutic targets. OBJECTIVE To determine associations among computational model-derived reinforcement learning parameters, depression symptoms, and symptom changes after treatment. DESIGN, SETTING, AND PARTICIPANTS In this mixed cross-sectional-cohort study, individuals performed reward and loss variants of a probabilistic learning task during functional magnetic resonance imaging at baseline and follow-up. A volunteer sample with and without a depression diagnosis was recruited from the community. Participants were assessed from July 2011 to February 2017, and data were analyzed from May 2017 to May 2021. MAIN OUTCOMES AND MEASURES Computational model-based analyses of participants' choices assessed a priori hypotheses about associations between components of reward-based and loss-based learning with depression symptoms. Changes in both learning parameters and symptoms were then assessed in a subset of participants who received cognitive behavioral therapy (CBT). RESULTS Of 101 included adults, 69 (68.3%) were female, and the mean (SD) age was 34.4 (11.2) years. A total of 69 participants with a depression diagnosis and 32 participants without a depression diagnosis were included at baseline; 48 participants (28 with depression who received CBT and 20 without depression) were included at follow-up (mean [SD] of 115.1 [15.6] days). Computational model-based analyses of behavioral choices and neural data identified associations of learning with symptoms during reward learning and loss learning, respectively. During reward learning only, anhedonia (and not negative affect or arousal) was associated with model-derived learning parameters (learning rate: posterior mean regression beta = -0.14; 95% credible interval [CrI], -0.12 to -0.03; outcome sensitivity: posterior mean regression beta = 0.18; 95% CrI, 0.02 to 0.37) and neural learning signals (moderation of association between striatal prediction error and expected value signals: t(97) = -2.10; P =.04). During loss learning only, negative affect (and not anhedonia or arousal) was associated with learning parameters (outcome shift: posterior mean regression beta = -0.11; 95% CrI, -0.20 to -0.01) and disrupted neural encoding of learning signals (association with subgenual anterior cingulate prediction error signals: r = -0.28; P =.005). Symptom improvement following CBT was associated with normalization of learning parameters that were disrupted at baseline (reward learning rate: posterior mean regression beta = 0.15; 90% CrI, 0.001 to 0.41; loss outcome shift: posterior mean regression beta = 0.42; 90% CrI, 0.09 to 0.77). CONCLUSIONS AND RELEVANCE In this study, the mapping of reinforcement learning components to symptoms of major depression revealed mechanistic features associated with these symptoms and points to possible learning-based therapeutic processes and targets.

Serotonin Modulates Sensitivity to Reward and Negative Feedback in a Probabilistic Reversal Learning Task in Rats

Selective Effects of 5-HT2C Receptor Modulation on Performance of a Novel Valence-Probe Visual Discrimination Task and Probabilistic Reversal Learning in Mice.

Comparable roles for serotonin in rats and humans for computations underlying flexible decision-making

Effects of cognitive judgement bias and acute antidepressant treatment on sensitivity to feedback and cognitive flexibility in the rat version of the probabilistic reversal-learning test

Serotonergic Modulation of Prefrontal Cortex during Negative Feedback in Probabilistic Reversal Learning

Serotonin depletion impairs both Pavlovian and instrumental reversal learning in healthy humans

Serotonin Modulates the Effects of Pavlovian Aversive Predictions on Response Vigor.

Probabilistic Reversal Learning under Acute Tryptophan Depletion in Healthy Humans: a Conventional Analysis

Role of Central Serotonin in Anticipation of Rewarding and Punishing Outcomes: Effects of Selective Amygdala or Orbitofrontal 5-Ht Depletion

Serotonergic Innervations Of The Orbitofrontal And Medial-Prefrontal Cortices Are Differentially Involved In Visual Discrimination And Reversal Learning In Rats

Poor decision making and sociability impairment following central serotonin reduction in inducible TPH2-knockdown rats

Valence-dependent Influence of Serotonin Depletion on Model-Based Choice Strategy

Serotoninergic regulation of emotional and behavioural control processes.

Enrichment Environment Positively Influences Depression- and Anxiety-Like Behavior in Serotonin Transporter Knockout Rats through the Modulation of Neuroplasticity, Spine, and GABAergic Markers

Serotonin Depletion Induces ‘waiting Impulsivity’ on the Human Four-Choice Serial Reaction Time Task: Cross-Species Translational Significance

Dissociable Effects of Selective 5-Ht2a and 5-Ht2c Receptor Antagonists on Serial Spatial Reversal Learning in Rats

Serotonin Induces Long-Term Depression at Corticostriatal Synapses

Reconciling the Role of Serotonin in Behavioral Inhibition and Aversion: Acute Tryptophan Depletion Abolishes Punishment-Induced Inhibition in Humans

Reinforcement Learning Disruptions in Individuals with Depression and Sensitivity to Symptom Change Following Cognitive Behavioral Therapy

5-HT 2A and 5-HT 2C receptor antagonism differentially modulate reinforcement learning and cognitive flexibility: behavioural and computational evidence