Abstract:The neurotransmitter dopamine is implicated in diverse functions, including reward processing, reinforcement learning, and cognitive control. The tendency to discount future rewards over time has long been discussed in the context of potential dopaminergic modulation. Here we examined the effect of a single dose of the D2 receptor antagonist haloperidol (2 mg) on temporal discounting in healthy female and male human participants. Our approach extends previous pharmacological studies in two ways. First, we applied combined temporal discounting drift diffusion models to examine choice dynamics. Second, we examined dopaminergic modulation of reward magnitude effects on temporal discounting. Hierarchical Bayesian parameter estimation revealed that the data were best accounted for by a temporal discounting drift diffusion model with nonlinear trialwise drift rate scaling. This model showed good parameter recovery, and posterior predictive checks revealed that it accurately reproduced the relationship between decision conflict and response times in individual participants. We observed reduced temporal discounting and substantially faster nondecision times under haloperidol compared with placebo. Discounting was steeper for low versus high reward magnitudes, but this effect was largely unaffected by haloperidol. Results were corroborated by model-free analyses and modeling via more standard approaches. We previously reported elevated caudate activation under haloperidol in this sample of participants, supporting the idea that haloperidol elevated dopamine neurotransmission (e.g., by blocking inhibitory feedback via presynaptic D2 auto-receptors). The present results reveal that this is associated with an augmentation of both lower-level (nondecision time) and higher-level (temporal discounting) components of the decision process.SIGNIFICANCE STATEMENT Dopamine is implicated in reward processing, reinforcement learning, and cognitive control. Here we examined the effects of a single dose of the D2 receptor antagonist haloperidol on temporal discounting and choice dynamics during the decision process. We extend previous studies by applying computational modeling using the drift diffusion model, which revealed that haloperidol reduced the nondecision time and reduced impulsive choice compared with placebo. These findings are compatible with a haloperidol-induced increase in striatal dopamine (e.g., because of a presynaptic mechanism). Our data provide novel insights into the contributions of dopamine to value-based decision-making and highlight how comprehensive model-based analyses using sequential sampling models can inform the effects of pharmacological modulation on choice processes.

Behavioral economics of drug self-administration. I. Functional equivalence of response requirement and drug dose

Contextual and psychosocial factors influencing drug reward in humans: The importance of non-drug reinforcement

Substance-related cross-commodity purchase tasks: A systematic review.

An investigation of economic interactions between social reinforcement and heroin or cocaine in rats

The endowment effect and temporal discounting of drug and non-drug commodities

Demand for food and cocaine in Fischer and Lewis rats.

Explaining the Escalation of Drug Use in Substance Dependence: Models and Appropriate Animal Laboratory Tests

The Behavioral Economics and Neuroeconomics of Alcohol Use Disorders

Dopaminergic Modulation of Human Intertemporal Choice: A Diffusion Model Analysis Using the D2-Receptor Antagonist Haloperidol

The influence of drug class on reward in substance use disorders

Recent research on response disequilibrium theory: A concise review

A novel baseline-effect shift tracking model for more sensitive detection of differences in the effects of closely related dopamine transporter inhibitor/ sigma receptor antagonist drug combinations on psychostimulant use.

Delineating anticipatory arousal from reward consumption: evaluating fixed-intervals in cocaine seeking-taking response chains

Non-pharmacological factors that determine drug use and addiction

Dissociable Effects of D-Amphetamine, Chlordiazepoxide and Alpha-Flupenthixol on Choice and Rate Measures of Reinforcement in the Rat.

Reply to Bickel

Bilateral Intra-Accumbens Self-Administration of D-Amphetamine: Antagonism with Intra-Accumbens SCH-23390 and Sulpiride.

Latent factor structure of a behavioral economic marijuana demand curve

A steady-state test of the demand curve analysis of relative reinforcer efficacy.

Drug discrimination learning: Interoceptive stimulus control of behavior and its implications for regulated and dysregulated drug intake

On the Challenges of using Reinforcement Learning in Precision Drug Dosing: Delay and Prolongedness of Action Effects