Abstract:Cognitive flexibility refers to the ability to adjust to changes in the environment and is essential for adaptive behavior. It can be investigated using laboratory tests such as probabilistic reversal learning (PRL). In individuals with both Cocaine Use Disorder (CUD) and Gambling Disorder (GD), overall impairments in PRL flexibility are observed. However, it is poorly understood whether this impairment depends on the same brain mechanisms in cocaine and gambling addictions. Reinforcement learning (RL) is the process by which rewarding or punishing feedback from the environment is used to adjust behavior, to maximise reward and minimise punishment. Using RL models, a deeper mechanistic explanation of the latent processes underlying cognitive flexibility can be gained. Here, we report results from a re-analysis of PRL data from control participants (n=18) and individuals with either GD (n=18) or CUD (n=20) using a hierarchical Bayesian RL approach. We observed significantly reduced ‘stimulus stickiness’ (i.e., stimulus-bound perseveration) in GD, which may reflect increased exploratory behavior that is insensitive to outcomes. RL parameters were unaffected in CUD. We relate the behavioral findings to their underlying neural substrates through an analysis of task-based fMRI data. We report differences in tracking reward and punishment expected values (EV) in individuals with GD compared to controls, with greater activity during reward EV tracking in the cingulate gyrus and amygdala. In CUD, we observed reduced responses to positive punishment prediction errors (PPE) and increased activity following negative PPEs in the superior frontal gyrus compared to controls. Thus, an RL framework serves to differentiate behavior in a probabilistic learning paradigm in two compulsive disorders, GD and CUD. ### Competing Interest Statement The Centre for Gambling Research at UBC (L.C.) is funded by support from the Province of British Columbia and the British Columbia Lottery Corporation. J.W.D. has received research grants from Boehringer Ingelheim Pharma GmbH and GlaxoSmithKline and receives royalties from Springer Verlag. T.W.R. discloses consultancy with Cambridge Cognition; he receives editorial honoraria from Springer-Nature and Elsevier and a research grant from Shionogi. R.N.C. consults for Campden Instruments and receives royalties from Cambridge Enterprise, Routledge, and Cambridge University Press.

Computational modeling of decision-making in substance abusers: testing Bechara's hypotheses

Decision-Making Under Risk and Uncertainty by Substance Abusers and Healthy Controls

A generalizable computational mechanism underlying the interaction between momentary craving and decision-making

Computational Modelling of Reinforcement Learning and Functional Neuroimaging of Probabilistic Reversal for Dissociating Compulsive Behaviours in Gambling and Cocaine Use Disorders

Modeling Decision-Making Systems in Addiction

Neural correlates of model-based behavior in internet gaming disorder and alcohol use disorder

Decision-Making by Patients With Methamphetamine Use Disorder Receiving Contingency Management Treatment: Magnitude and Frequency Effects

Decision-making Deficits in Drug Addiction

Beyond pain: modeling decision-making deficits in chronic pain

Decision-making deficits in drug addiction.

Computational modeling of reinforcement learning and functional neuroimaging of probabilistic reversal dissociates compulsive behaviors in Gambling and Cocaine Use Disorders

Working Memory and Affective Decision-Making in Addiction: a Neurocognitive Comparison Between Heroin Addicts, Pathological Gamblers and Healthy Controls.

Decision Making in Children and Adolescents: Impaired Iowa Gambling Task Performance in Early Adolescence.

Addiction beyond pharmacological effects: The role of environment complexity and bounded rationality

Impaired Outcome Evaluation During Risky Decision-Making in Individuals with Methamphetamine Use Disorder

Impairment of Drug Addiction on Decision Making and Recovery after Abstinence

Abnormal Affective Decision Making Revealed in Adolescent Binge Drinkers Using A Functional Magnetic Resonance Imaging Study

Neuropsychological, impulsive personality, and cerebral oxygenation correlates of undergraduate polysubstance use

The differential neural substrates for reward choice under gain-loss contexts and risk in alcohol use disorder: Evidence from a voxel-based meta-analysis

Impact of provoked stress on model-free and model-based reinforcement learning in individuals with alcohol use disorder

The role of reinforcement learning in shaping the decision policy in methamphetamine use disorders