Abstract:Gambling disorder is associated with deficits in reward-based learning, but the underlying computational mechanisms are still poorly understood. Here, we examined this issue using a stationary reinforcement learning task in combination with computational modeling and functional resonance imaging (fMRI) in individuals that regular participate in gambling (n = 23, seven fulfilled one to three DSM 5 criteria for gambling disorder, sixteen fulfilled four or more) and matched controls (n = 23). As predicted, the gambling group exhibited substantially reduced accuracy, whereas overall response times (RTs) were not reliably different between groups. We then used comprehensive modeling using reinforcement learning drift diffusion models (RLDDMs) in combination with hierarchical Bayesian parameter estimation to shed light on the computational underpinnings of this performance deficit. In both groups, an RLDDM in which both non-decision time and decision threshold (boundary separation) changed over the course of the experiment accounted for the data best. The model showed good parameter and model recovery, and posterior predictive checks revealed that, in both groups, the model accurately reproduced the evolution of accuracies and RTs over time. Modeling revealed that, compared to controls, the learning impairment in the gambling group was linked to a more rapid reduction in decision thresholds over time, and a reduced impact of value-differences on the drift rate. The gambling group also showed shorter non-decision times. FMRI analyses replicated effects of prediction error coding in the ventral striatum and value coding in the ventro-medial prefrontal cortex, but there was no credible evidence for group differences in these effects. Taken together, our findings show that reinforcement learning impairments in disordered gambling are linked to both maladaptive decision threshold adjustments and a reduced consideration of option values in the choice process.

Neural Substrates of the Drift-Diffusion Model in Brain Disorders

Delay-period Activity in Frontal, Parietal, and Occipital Cortex Tracks Noise and Biases in Visual Working Memory

Informing cognitive abstractions through neuroimaging: The neural drift diffusion model.

A practical introduction to using the drift diffusion model of decision-making in cognitive psychology, neuroscience, and health sciences

Dissociated neural substrates underlying impulsive choice and impulsive action.

Brain Mechanisms for Perceptual and Reward-Related Decision-Making

Clarifying Cognitive Control Deficits in Psychosis via Drift Diffusion Modeling and Attractor Dynamics

An Overcomplete Approach to Fitting Drift-Diffusion Decision Models to Trial-By-Trial Data

Testing the drift-diffusion model

The drift diffusion model as the choice rule in inter-temporal and risky choice: a case study in medial orbitofrontal cortex lesion patients and controls

Drift in Centrality of Different Brain Regions in an Anatomical Neural Network with Parkinson's Disease: A View from Complex Network Analysis.

Drift-Diffusion Model Parameters Underlying Cognitive Mechanism and Perceptual Learning in Autism Spectrum Disorder

Decision making and neuropsychiatry

Model of a striatal circuit exploring biological mechanisms underlying decision-making during normal and disordered states

Neural correlates of model-based behavior in internet gaming disorder and alcohol use disorder

Decomposition of Reinforcement Learning Deficits in Disordered Gambling via Drift Diffusion Modeling and Functional Magnetic Resonance Imaging

Drift-Diffusion Model Reveals Impaired Reward-Based Perceptual Decision-Making Processes Associated with Depression in Late Childhood and Early Adolescent Girls

The drift diffusion model as the choice rule in reinforcement learning

The computational and neural substrates of individual differences in impulsivity under loss framework

Unifying and generalizing models of neural dynamics during decision-making

Using Drift Diffusion and RL Models to Disentangle Effects of Depression On Decision-Making vs. Learning in the Probabilistic Reward Task