Abstract:Cognitive flexibility refers to the ability to adjust to changes in the environment and is essential for adaptive behavior. It can be investigated using laboratory tests such as probabilistic reversal learning (PRL). In individuals with both Cocaine Use Disorder (CUD) and Gambling Disorder (GD), overall impairments in PRL flexibility are observed. However, it is poorly understood whether this impairment depends on the same brain mechanisms in cocaine and gambling addictions. Reinforcement learning (RL) is the process by which rewarding or punishing feedback from the environment is used to adjust behavior, to maximise reward and minimise punishment. Using RL models, a deeper mechanistic explanation of the latent processes underlying cognitive flexibility can be gained. Here, we report results from a re-analysis of PRL data from control participants (n=18) and individuals with either GD (n=18) or CUD (n=20) using a hierarchical Bayesian RL approach. We observed significantly reduced ‘stimulus stickiness’ (i.e., stimulus-bound perseveration) in GD, which may reflect increased exploratory behavior that is insensitive to outcomes. RL parameters were unaffected in CUD. We relate the behavioral findings to their underlying neural substrates through an analysis of task-based fMRI data. We report differences in tracking reward and punishment expected values (EV) in individuals with GD compared to controls, with greater activity during reward EV tracking in the cingulate gyrus and amygdala. In CUD, we observed reduced responses to positive punishment prediction errors (PPE) and increased activity following negative PPEs in the superior frontal gyrus compared to controls. Thus, an RL framework serves to differentiate behavior in a probabilistic learning paradigm in two compulsive disorders, GD and CUD. ### Competing Interest Statement The Centre for Gambling Research at UBC (L.C.) is funded by support from the Province of British Columbia and the British Columbia Lottery Corporation. J.W.D. has received research grants from Boehringer Ingelheim Pharma GmbH and GlaxoSmithKline and receives royalties from Springer Verlag. T.W.R. discloses consultancy with Cambridge Cognition; he receives editorial honoraria from Springer-Nature and Elsevier and a research grant from Shionogi. R.N.C. consults for Campden Instruments and receives royalties from Cambridge Enterprise, Routledge, and Cambridge University Press.

Computational modelling reveals contrasting effects on reinforcement learning and cognitive flexibility in stimulant use disorder and obsessive-compulsive disorder: remediating effects of dopaminergic D2/3 receptor agents

Computational modelling reveals contrasting effects on reinforcement learning and cognitive flexibility in stimulant use disorder and obsessive compulsive disorder: remediating …

Impaired Learning from Negative Feedback in Stimulant Use Disorder: Dopaminergic Modulation.

Compulsive Drug Use is Associated with Imbalance of Orbitofrontal- and Prelimbic-Striatal Circuits in Punishment-Resistant Individuals

Response Perseveration in Stimulant Dependence is Associated with Striatal Dysfunction and Can Be Ameliorated by a D(2/3) Receptor Agonist.

Dopaminergic Drug Treatment Remediates Exaggerated Cingulate Prediction Error Responses in Obsessive-Compulsive Disorder.

Influence of Compulsivity of Drug Abuse on Dopaminergic Modulation of Attentional Bias in Stimulant Dependence.

Reduced brain connectivity underlying value-based choices and outcomes in stimulant use disorder

Effects of dopamine D2/3 and opioid receptor antagonism on the trade-off between model-based and model-free behaviour in healthy volunteers

Computational Modelling of Reinforcement Learning and Functional Neuroimaging of Probabilistic Reversal for Dissociating Compulsive Behaviours in Gambling and Cocaine Use Disorders

Impairments in Reinforcement Learning Do Not Explain Enhanced Habit Formation in Cocaine Use Disorder

Chronic Cocaine but Not Chronic Amphetamine Use is Associated with Perseverative Responding in Humans

Perseveration and Shifting in Obsessive-Compulsive Disorder as a Function of Uncertainty, Punishment, and Serotonergic Medication

Computational modeling of reinforcement learning and functional neuroimaging of probabilistic reversal dissociates compulsive behaviors in Gambling and Cocaine Use Disorders

Compulsive Drug-Taking is Associated with Habenula–frontal Cortex Connectivity

Brain Functional Connectivity in Stimulant Drug Dependence and Obsessive–compulsive Disorder

Individuals with problem gambling and obsessive-compulsive disorder learn through distinct reinforcement mechanisms

Dopamine Release in Dissociable Striatal Subregions Predicts the Different Effects of Oral Methylphenidate on Reversal Learning and Spatial Working Memory

Tryptophan depletion impairs stimulus-reward learning while methylphenidate disrupts attentional control in healthy young adults: implications for the monoaminergic basis of impulsive behaviour

Selective and Interactive Effects of D2 Receptor Antagonism and Positive Allosteric Mglur4 Modulation on Waiting Impulsivity.

Disorders of Compulsivity: a Common Bias Towards Learning Habits.