Abstract:IMPORTANCE Major depressive disorder is prevalent and impairing. Parsing neurocomputational substrates of reinforcement learning in individuals with depression may facilitate a mechanistic understanding of the disorder and suggest new cognitive therapeutic targets. OBJECTIVE To determine associations among computational model-derived reinforcement learning parameters, depression symptoms, and symptom changes after treatment. DESIGN, SETTING, AND PARTICIPANTS In this mixed cross-sectional-cohort study, individuals performed reward and loss variants of a probabilistic learning task during functional magnetic resonance imaging at baseline and follow-up. A volunteer sample with and without a depression diagnosis was recruited from the community. Participants were assessed from July 2011 to February 2017, and data were analyzed from May 2017 to May 2021. MAIN OUTCOMES AND MEASURES Computational model-based analyses of participants' choices assessed a priori hypotheses about associations between components of reward-based and loss-based learning with depression symptoms. Changes in both learning parameters and symptoms were then assessed in a subset of participants who received cognitive behavioral therapy (CBT). RESULTS Of 101 included adults, 69 (68.3%) were female, and the mean (SD) age was 34.4 (11.2) years. A total of 69 participants with a depression diagnosis and 32 participants without a depression diagnosis were included at baseline; 48 participants (28 with depression who received CBT and 20 without depression) were included at follow-up (mean [SD] of 115.1 [15.6] days). Computational model-based analyses of behavioral choices and neural data identified associations of learning with symptoms during reward learning and loss learning, respectively. During reward learning only, anhedonia (and not negative affect or arousal) was associated with model-derived learning parameters (learning rate: posterior mean regression beta = -0.14; 95% credible interval [CrI], -0.12 to -0.03; outcome sensitivity: posterior mean regression beta = 0.18; 95% CrI, 0.02 to 0.37) and neural learning signals (moderation of association between striatal prediction error and expected value signals: t(97) = -2.10; P =.04). During loss learning only, negative affect (and not anhedonia or arousal) was associated with learning parameters (outcome shift: posterior mean regression beta = -0.11; 95% CrI, -0.20 to -0.01) and disrupted neural encoding of learning signals (association with subgenual anterior cingulate prediction error signals: r = -0.28; P =.005). Symptom improvement following CBT was associated with normalization of learning parameters that were disrupted at baseline (reward learning rate: posterior mean regression beta = 0.15; 90% CrI, 0.001 to 0.41; loss outcome shift: posterior mean regression beta = 0.42; 90% CrI, 0.09 to 0.77). CONCLUSIONS AND RELEVANCE In this study, the mapping of reinforcement learning components to symptoms of major depression revealed mechanistic features associated with these symptoms and points to possible learning-based therapeutic processes and targets.

Reinforcement and Reversal Learning in First-Episode Psychosis.

Abnormal Reward Prediction-Error Signalling in Antipsychotic Naive Individuals with First-Episode Psychosis or Clinical Risk for Psychosis

Discrimination Learning, Reversal, and Set-Shifting in First-Episode Schizophrenia: Stability over Six Years and Specific Associations with Medication Type and Disorganization Syndrome.

Substantia Nigra/Ventral Tegmental Reward Prediction Error Disruption in Psychosis

Predicting psychosis across diagnostic boundaries: Behavioral and computational modeling evidence for impaired reinforcement learning in schizophrenia and bipolar disorder with a history of psychosis.

Distinct alterations in probabilistic reversal learning across at-risk mental state, first episode psychosis and persistent schizophrenia

Incentive Motivation in First-Episode Psychosis: a Behavioural Study.

Probabilistic Learning and Reversal Deficits in Patients with Parkinson’s Disease or Frontal or Temporal Lobe Lesions: Possible Adverse Effects of Dopaminergic Medication

The prediction-error hypothesis of schizophrenia: new data point to circuit-specific changes in dopamine activity

Dorsal and Ventral Striatal Dopamine D1 and D2 Receptors Differentially Modulate Distinct Phases of Serial Visual Reversal Learning.

Cortical and Striatal Reward Processing in Parkinson's Disease Psychosis.

Defining the Neural Mechanisms of Probabilistic Reversal Learning Using Event-Related Functional Magnetic Resonance Imaging

Associations of Reversal Learning Performance With Personality Disorder Profile and Drug Abuse History in a Sample of Prison Inmates

Discrimination, Reversal, and Shift Learning in Huntington’s Disease: Mechanisms of Impaired Response Selection

Negative symptoms and the failure to represent the expected reward value of actions: behavioral and computational modeling evidence

Atypical prediction error learning is associated with prodromal symptoms in individuals at clinical high risk for psychosis

Reinforcement Learning Disruptions in Individuals with Depression and Sensitivity to Symptom Change Following Cognitive Behavioral Therapy

Reward disturbances in antipsychotic-naïve patients with first-episode psychosis and their association to glutamate levels

Selective Lesions of the Dorsomedial Striatum Impair Serial Spatial Reversal Learning in Rats

Different learning aberrations relate to delusion-like beliefs with different contents

Disrupted Prediction-Error Signal in Psychosis: Evidence for an Associative Account of Delusions.