Abstract:Abstract Sequential sampling models such as the drift diffusion model have a long tradition in research on perceptual decision-making, but mounting evidence suggests that these models can account for response time distributions that arise during reinforcement learning and value-based decision-making. Building on this previous work, we implemented the drift diffusion model as the choice rule in inter-temporal choice ( temporal discounting ) and risky choice ( probability discounting ) using a hierarchical Bayesian estimation scheme. We validated our approach in data from nine patients with focal lesions to the ventromedial prefrontal cortex / medial orbitofrontal cortex (vmPFC/mOFC) and nineteen age- and education-matched controls. Choice model parameters estimated via standard softmax action selection were reliably reproduced using the drift diffusion model as the choice rule, both for temporal discounting and risky choice. Model comparison revealed that, for both tasks, the data were best accounted for by a variant of the drift diffusion model including a non-linear mapping from value-differences to trial-wise drift rates. Posterior predictive checks of the winning models revealed a reasonably good fit to individual participants reaction time distributions. We then applied this modeling framework and 1) reproduced our previous results regarding temporal discounting in vmPFC/mOFC patients and 2) showed in a previously unpublished data set on risky choice that vmPFC/mOFC patients exhibit increased risk-taking relative to controls. Analyses of diffusion model parameters revealed that vmPFC/mOFC damage abolished neither value sensitivity nor asymptote of the drift rate. Rather, it substantially increased non-decision times and reduced response caution during risky choice. Our results highlight that novel insights can be gained from applying sequential sampling models in studies of inter-temporal and risky decision-making in cognitive neuroscience.

HDDM: Hierarchical Bayesian estimation of the Drift-Diffusion Model in Python

A Hitchhiker’s Guide to Bayesian Hierarchical Drift-Diffusion Modeling with Dockerhddm

An Overcomplete Approach to Fitting Drift-Diffusion Decision Models to Trial-By-Trial Data

A Bayesian hierarchical diffusion model decomposition of performance in Approach-Avoidance Tasks

A practical introduction to using the drift diffusion model of decision-making in cognitive psychology, neuroscience, and health sciences

Testing the drift-diffusion model

A Bayesian Reformulation of the Extended Drift-Diffusion Model in Perceptual Decision Making

Informing cognitive abstractions through neuroimaging: The neural drift diffusion model.

Piecewise constant averaging methods allow for fast and accurate hierarchical Bayesian estimation of drift diffusion models with time-varying evidence accumulation rates

Inclusion Bayes factors for mixed hierarchical diffusion decision models.

A Bayesian Hierarchical Model of Trial-to-Trial Fluctuations in Decision Criterion

Support for the Time-Varying Drift Rate Model of Perceptual Discrimination in Dynamic and Static Noise Using Bayesian Model-Fitting Methodology

The Seven-parameter Diffusion Model: an Implementation in Stan for Bayesian Analyses

The drift diffusion model as the choice rule in inter-temporal and risky choice: a case study in medial orbitofrontal cortex lesion patients and controls

Bayesian Framework for Modeling Diffusion Processes with Nonlinear Drift Based on Nonlinear and Incomplete Observations.

MD3F: Multivariate Distance Drift Diffusion Framework for High-Dimensional Datasets

A novel method for sparse dynamic functional connectivity analysis from resting-state fMRI

Fitting the ratcliff diffusion model to experimental data

The drift diffusion model as the choice rule in reinforcement learning

A Hierarchical Bayesian Model for Inferring and Decision Making in Multi-Dimensional Volatile Binary Environments

Connecting process models to response times through Bayesian hierarchical regression analysis