Abstract:Cognitive flexibility refers to the ability to adjust to changes in the environment and is essential for adaptive behavior. It can be investigated using laboratory tests such as probabilistic reversal learning (PRL). In individuals with both Cocaine Use Disorder (CUD) and Gambling Disorder (GD), overall impairments in PRL flexibility are observed. However, it is poorly understood whether this impairment depends on the same brain mechanisms in cocaine and gambling addictions. Reinforcement learning (RL) is the process by which rewarding or punishing feedback from the environment is used to adjust behavior, to maximise reward and minimise punishment. Using RL models, a deeper mechanistic explanation of the latent processes underlying cognitive flexibility can be gained. Here, we report results from a re-analysis of PRL data from control participants (n=18) and individuals with either GD (n=18) or CUD (n=20) using a hierarchical Bayesian RL approach. We observed significantly reduced ‘stimulus stickiness’ (i.e., stimulus-bound perseveration) in GD, which may reflect increased exploratory behavior that is insensitive to outcomes. RL parameters were unaffected in CUD. We relate the behavioral findings to their underlying neural substrates through an analysis of task-based fMRI data. We report differences in tracking reward and punishment expected values (EV) in individuals with GD compared to controls, with greater activity during reward EV tracking in the cingulate gyrus and amygdala. In CUD, we observed reduced responses to positive punishment prediction errors (PPE) and increased activity following negative PPEs in the superior frontal gyrus compared to controls. Thus, an RL framework serves to differentiate behavior in a probabilistic learning paradigm in two compulsive disorders, GD and CUD. ### Competing Interest Statement The Centre for Gambling Research at UBC (L.C.) is funded by support from the Province of British Columbia and the British Columbia Lottery Corporation. J.W.D. has received research grants from Boehringer Ingelheim Pharma GmbH and GlaxoSmithKline and receives royalties from Springer Verlag. T.W.R. discloses consultancy with Cambridge Cognition; he receives editorial honoraria from Springer-Nature and Elsevier and a research grant from Shionogi. R.N.C. consults for Campden Instruments and receives royalties from Cambridge Enterprise, Routledge, and Cambridge University Press.

Associations of Reversal Learning Performance With Personality Disorder Profile and Drug Abuse History in a Sample of Prison Inmates

Impulsivity in antisocial personality disorder and obsessive-compulsive personality disorder in prison population

Reinforcement and Reversal Learning in First-Episode Psychosis.

Computational modelling reveals contrasting effects on reinforcement learning and cognitive flexibility in stimulant use disorder and obsessive-compulsive disorder: remediating effects of dopaminergic D2/3 receptor agents

Probabilistic Learning and Reversal Deficits in Patients with Parkinson’s Disease or Frontal or Temporal Lobe Lesions: Possible Adverse Effects of Dopaminergic Medication

Reward and Punishment Sensitivity are Associated with Cross-disorder Traits

Computational modelling reveals contrasting effects on reinforcement learning and cognitive flexibility in stimulant use disorder and obsessive compulsive disorder: remediating …

Chronic Cocaine but Not Chronic Amphetamine Use is Associated with Perseverative Responding in Humans

Computational modeling of reinforcement learning and functional neuroimaging of probabilistic reversal dissociates compulsive behaviors in Gambling and Cocaine Use Disorders

High Impulsivity Predicts Relapse to Cocaine-Seeking after Punishment-Induced Abstinence

Contingency-based flexibility mechanisms through a reinforcement learning model in adults with Attention-Deficit/Hyperactivity Disorder and Obsessive-Compulsive Disorder

Decision-Making Under Risk and Uncertainty by Substance Abusers and Healthy Controls

Disentangling associations between impulsivity, compulsivity, and performance monitoring

Computational Modelling of Reinforcement Learning and Functional Neuroimaging of Probabilistic Reversal for Dissociating Compulsive Behaviours in Gambling and Cocaine Use Disorders

Mesencephalic projections to the nucleus accumbens shell modulate value updating during probabilistic reversal learning

Dissociable Contributions of Basolateral Amygdala and Ventrolateral Orbitofrontal Cortex to Flexible Learning Under Uncertainty

Perseveration and Shifting in Obsessive-Compulsive Disorder as a Function of Uncertainty, Punishment, and Serotonergic Medication

Distinct alterations in probabilistic reversal learning across at-risk mental state, first episode psychosis and persistent schizophrenia

Psychopathy and substance use predict recidivism in women: A 7-year prospective study.

Personality-related factors among incarcerated recidivist drug dealers: A path analysis

Prior cocaine use diminishes encoding of latent information by orbitofrontal, but not medial, prefrontal ensembles