Abstract:Abstract Sequential sampling models such as the drift diffusion model have a long tradition in research on perceptual decision-making, but mounting evidence suggests that these models can account for response time distributions that arise during reinforcement learning and value-based decision-making. Building on this previous work, we implemented the drift diffusion model as the choice rule in inter-temporal choice ( temporal discounting ) and risky choice ( probability discounting ) using a hierarchical Bayesian estimation scheme. We validated our approach in data from nine patients with focal lesions to the ventromedial prefrontal cortex / medial orbitofrontal cortex (vmPFC/mOFC) and nineteen age- and education-matched controls. Choice model parameters estimated via standard softmax action selection were reliably reproduced using the drift diffusion model as the choice rule, both for temporal discounting and risky choice. Model comparison revealed that, for both tasks, the data were best accounted for by a variant of the drift diffusion model including a non-linear mapping from value-differences to trial-wise drift rates. Posterior predictive checks of the winning models revealed a reasonably good fit to individual participants reaction time distributions. We then applied this modeling framework and 1) reproduced our previous results regarding temporal discounting in vmPFC/mOFC patients and 2) showed in a previously unpublished data set on risky choice that vmPFC/mOFC patients exhibit increased risk-taking relative to controls. Analyses of diffusion model parameters revealed that vmPFC/mOFC damage abolished neither value sensitivity nor asymptote of the drift rate. Rather, it substantially increased non-decision times and reduced response caution during risky choice. Our results highlight that novel insights can be gained from applying sequential sampling models in studies of inter-temporal and risky decision-making in cognitive neuroscience.

RT-MPTs: Process models for response-time distributions with diffusion-model kernels

Connecting process models to response times through Bayesian hierarchical regression analysis

Modeling Conditional Dependence of Response Accuracy and Response Time with the Diffusion Item Response Theory Model

A Bayesian hierarchical diffusion model decomposition of performance in Approach-Avoidance Tasks

Benefits of multinomial processing tree models with discrete and continuous variables in memory research: an alternative modeling proposal to Juola et al. (2019)

Fitting the ratcliff diffusion model to experimental data

Response Time Improves Choice Prediction and Function Estimation for Gaussian Process Models of Perception and Preferences

A diffusion model decomposition of the practice effect

The Seven-parameter Diffusion Model: an Implementation in Stan for Bayesian Analyses

A latent space accumulator model for response time: Applications to cognitive assessment data

A Latent Hidden Markov Model for Process Data

On the relation between the (censored) shifted Wald and the Wiener distribution as measurement models for choice response times

Parallel and serial task processing in the PRP paradigm: a drift-diffusion model approach

The thermodynamics of human reaction times

Response times in Ecological Momentary Assessment (EMA): shedding light on the response process with a drift diffusion model

A Mixture Response Time Process Model for Aberrant Behaviors and Item Nonresponses

The drift diffusion model as the choice rule in inter-temporal and risky choice: a case study in medial orbitofrontal cortex lesion patients and controls

A critical comparison of discrete-state and continuous models of recognition memory: Implications for recognition and beyond.

Learning diffusion coefficients, kinetic parameters, and the number of underlying states from a multi-state diffusion process: robustness results and application to PDK1/PKC$α$, dynamics

A Multinomial Processing Tree Model of the 2-back Working Memory Task

Validation and Comparison of Non-Stationary Cognitive Models: A Diffusion Model Application