Abstract:Cognitive flexibility refers to the ability to adjust to changes in the environment and is essential for adaptive behavior. It can be investigated using laboratory tests such as probabilistic reversal learning (PRL). In individuals with both Cocaine Use Disorder (CUD) and Gambling Disorder (GD), overall impairments in PRL flexibility are observed. However, it is poorly understood whether this impairment depends on the same brain mechanisms in cocaine and gambling addictions. Reinforcement learning (RL) is the process by which rewarding or punishing feedback from the environment is used to adjust behavior, to maximise reward and minimise punishment. Using RL models, a deeper mechanistic explanation of the latent processes underlying cognitive flexibility can be gained. Here, we report results from a re-analysis of PRL data from control participants (n=18) and individuals with either GD (n=18) or CUD (n=20) using a hierarchical Bayesian RL approach. We observed significantly reduced ‘stimulus stickiness’ (i.e., stimulus-bound perseveration) in GD, which may reflect increased exploratory behavior that is insensitive to outcomes. RL parameters were unaffected in CUD. We relate the behavioral findings to their underlying neural substrates through an analysis of task-based fMRI data. We report differences in tracking reward and punishment expected values (EV) in individuals with GD compared to controls, with greater activity during reward EV tracking in the cingulate gyrus and amygdala. In CUD, we observed reduced responses to positive punishment prediction errors (PPE) and increased activity following negative PPEs in the superior frontal gyrus compared to controls. Thus, an RL framework serves to differentiate behavior in a probabilistic learning paradigm in two compulsive disorders, GD and CUD. ### Competing Interest Statement The Centre for Gambling Research at UBC (L.C.) is funded by support from the Province of British Columbia and the British Columbia Lottery Corporation. J.W.D. has received research grants from Boehringer Ingelheim Pharma GmbH and GlaxoSmithKline and receives royalties from Springer Verlag. T.W.R. discloses consultancy with Cambridge Cognition; he receives editorial honoraria from Springer-Nature and Elsevier and a research grant from Shionogi. R.N.C. consults for Campden Instruments and receives royalties from Cambridge Enterprise, Routledge, and Cambridge University Press.

Computational modelling reveals contrasting effects on reinforcement learning and cognitive flexibility in stimulant use disorder and obsessive compulsive disorder: remediating …

Computational modelling reveals contrasting effects on reinforcement learning and cognitive flexibility in stimulant use disorder and obsessive-compulsive disorder: remediating effects of dopaminergic D2/3 receptor agents

Impaired Learning from Negative Feedback in Stimulant Use Disorder: Dopaminergic Modulation.

Compulsive Drug Use is Associated with Imbalance of Orbitofrontal- and Prelimbic-Striatal Circuits in Punishment-Resistant Individuals

Dopaminergic Drug Treatment Remediates Exaggerated Cingulate Prediction Error Responses in Obsessive-Compulsive Disorder.

Reduced brain connectivity underlying value-based choices and outcomes in stimulant use disorder

Influence of Compulsivity of Drug Abuse on Dopaminergic Modulation of Attentional Bias in Stimulant Dependence.

Response Perseveration in Stimulant Dependence is Associated with Striatal Dysfunction and Can Be Ameliorated by a D(2/3) Receptor Agonist.

Effects of dopamine D2/3 and opioid receptor antagonism on the trade-off between model-based and model-free behaviour in healthy volunteers

Computational Modelling of Reinforcement Learning and Functional Neuroimaging of Probabilistic Reversal for Dissociating Compulsive Behaviours in Gambling and Cocaine Use Disorders

Computational modeling of reinforcement learning and functional neuroimaging of probabilistic reversal dissociates compulsive behaviors in Gambling and Cocaine Use Disorders

Brain Functional Connectivity in Stimulant Drug Dependence and Obsessive–compulsive Disorder

Impairments in Reinforcement Learning Do Not Explain Enhanced Habit Formation in Cocaine Use Disorder

Chronic Cocaine but Not Chronic Amphetamine Use is Associated with Perseverative Responding in Humans

Compulsive Drug-Taking is Associated with Habenula–frontal Cortex Connectivity

Perseveration and Shifting in Obsessive-Compulsive Disorder as a Function of Uncertainty, Punishment, and Serotonergic Medication

Individuals with problem gambling and obsessive-compulsive disorder learn through distinct reinforcement mechanisms

Disorders of Compulsivity: a Common Bias Towards Learning Habits.

Altered model-based prediction error signalling in the medial prefrontal cortex in patients with obsessive-compulsive disorder: An fMRI study

Tryptophan depletion impairs stimulus-reward learning while methylphenidate disrupts attentional control in healthy young adults: implications for the monoaminergic basis of impulsive behaviour

Modulation of dlPFC function and decision-making capacity by repetitive transcranial magnetic stimulation in methamphetamine use disorder