Abstract:Cognitive flexibility refers to the ability to adjust to changes in the environment and is essential for adaptive behavior. It can be investigated using laboratory tests such as probabilistic reversal learning (PRL). In individuals with both Cocaine Use Disorder (CUD) and Gambling Disorder (GD), overall impairments in PRL flexibility are observed. However, it is poorly understood whether this impairment depends on the same brain mechanisms in cocaine and gambling addictions. Reinforcement learning (RL) is the process by which rewarding or punishing feedback from the environment is used to adjust behavior, to maximise reward and minimise punishment. Using RL models, a deeper mechanistic explanation of the latent processes underlying cognitive flexibility can be gained. Here, we report results from a re-analysis of PRL data from control participants (n=18) and individuals with either GD (n=18) or CUD (n=20) using a hierarchical Bayesian RL approach. We observed significantly reduced ‘stimulus stickiness’ (i.e., stimulus-bound perseveration) in GD, which may reflect increased exploratory behavior that is insensitive to outcomes. RL parameters were unaffected in CUD. We relate the behavioral findings to their underlying neural substrates through an analysis of task-based fMRI data. We report differences in tracking reward and punishment expected values (EV) in individuals with GD compared to controls, with greater activity during reward EV tracking in the cingulate gyrus and amygdala. In CUD, we observed reduced responses to positive punishment prediction errors (PPE) and increased activity following negative PPEs in the superior frontal gyrus compared to controls. Thus, an RL framework serves to differentiate behavior in a probabilistic learning paradigm in two compulsive disorders, GD and CUD. ### Competing Interest Statement The Centre for Gambling Research at UBC (L.C.) is funded by support from the Province of British Columbia and the British Columbia Lottery Corporation. J.W.D. has received research grants from Boehringer Ingelheim Pharma GmbH and GlaxoSmithKline and receives royalties from Springer Verlag. T.W.R. discloses consultancy with Cambridge Cognition; he receives editorial honoraria from Springer-Nature and Elsevier and a research grant from Shionogi. R.N.C. consults for Campden Instruments and receives royalties from Cambridge Enterprise, Routledge, and Cambridge University Press.

Response Perseveration and Ventral Prefrontal Sensitivity to Reward and Punishment in Male Problem Gamblers and Smokers

Decomposition of Reinforcement Learning Deficits in Disordered Gambling via Drift Diffusion Modeling and Functional Magnetic Resonance Imaging

Increased Ventral-Striatal Activity During Monetary Decision Making is a Marker of Problem Poker Gambling Severity

Computational Modelling of Reinforcement Learning and Functional Neuroimaging of Probabilistic Reversal for Dissociating Compulsive Behaviours in Gambling and Cocaine Use Disorders

Reward pathway dysfunction in gambling disorder: A meta-analysis of functional magnetic resonance imaging studies.

Serotonergic and Dopaminergic Modulation of Gambling Behavior As Assessed Using a Novel Rat Gambling Task.

Neural Correlates of Proactive and Reactive Motor Response Inhibition of Gambling Stimuli in Frequent Gamblers.

Individuals with problem gambling and obsessive-compulsive disorder learn through distinct reinforcement mechanisms

Frontal white and gray matter abnormality in gambling disorder: A multimodal MRI study

Computational and neural evidence for altered fast and slow learning from losses in gambling disorder

Increased Striatal Dopamine Synthesis Capacity in Gambling Addiction

Endogenous Cortisol Levels Are Associated with an Imbalanced Striatal Sensitivity to Monetary Versus Non-Monetary Cues in Pathological Gamblers

Computational modeling of reinforcement learning and functional neuroimaging of probabilistic reversal dissociates compulsive behaviors in Gambling and Cocaine Use Disorders

Dissociable Neural Processes During Risky Decision-Making in Individuals with Internet-Gaming Disorder

Exploratory study of associations between monetary reward anticipation brain responses and mu-opioid signalling in alcohol dependence, gambling disorder and healthy controls

Heterogeneity in Disordered Gambling: Decision-Making and Impulsivity in Gamblers Grouped by Preferred Form

Goal-Directed and Habitual Control in Smokers.

Dopamine mediates a directionally opposite correlation between empathy and the reinforcing effects of amphetamine and gambling in people with gambling disorder vs. healthy controls

Blunted sensitivity to expected value during risky decision making in individuals with problematic pornography use

Loss, gain and choice difficulty in gambling patients: Neural and behavioural processes

Increased Brain Reactivity to Gambling Unavailability As a Marker of Problem Gambling