Abstract:Dopamine (DA) and norepinephrine (NE) have been repeatedly implicated in neuropsychiatric vulnerability, in part via their roles in mediating the decision making processes. Although two neuromodulators share a synthesis pathway and are co-activated under states of arousal, they engage in distinct circuits and modulatory roles. However, the specific role of each neuromodulator in decision making, in particular the exploration-exploitation tradeoff, remains unclear. Revealing how each neuromodulator contributes to exploration-exploitation tradeoff is important in guiding mechanistic hypotheses emerging from computational psychiatric approaches. To understand the differences and overlaps of the roles of these two catecholamine systems in regulating exploration, a direct comparison using the same dynamic decision making task is needed. Here, we ran male and female mice in a restless two-armed bandit task, which encourages both exploration and exploitation. We systemically administered a nonselective DA antagonist (flupenthixol), a nonselective DA agonist (apomorphine), a NE beta-receptor antagonist (propranolol), and a NE beta-receptor agonist (isoproterenol), and examined changes in exploration within subjects across sessions. We found a bidirectional modulatory effect of dopamine on exploration. Increasing dopamine activity decreased exploration and decreasing dopamine activity increased exploration. The modulatory effect of beta-noradrenergic receptor activity on exploration was mediated by sex. Reinforcement learning model parameters suggested that dopamine modulation affected exploration via decision noise and norepinephrine modulation affected exploration via sensitivity to outcome. Together, these findings suggested that the mechanisms that govern the exploration-exploitation transition are sensitive to changes in both catecholamine functions and revealed differential roles for NE and DA in mediating exploration.Significance Statement Both dopamine (DA) and norepinephrine (NE) have been implicated in the decision making process. Although these two catecholamines have shared aspects of their biosynthetic pathways and projection targets, they are thought to exert many core functions via distinct neural targets and receptor subtypes. However, the computational neuroscience literature often ascribes similar roles to these catecholamines, despite the above evidence. Resolving this discrepancy is important in guiding mechanistic hypotheses emerging from computational psychiatric approaches. This study examines the role of dopamine and norepinephrine on the explore-exploit tradeoff. By testing mice, we were able to compare multiple pharmacological agents within subjects, and examine sources of individual differences, allowing direct comparison between the effects of these two catecholamines in modulating decision making.

Pharmacological characterization of sex differences in the effects of dopaminergic drugs on effort-based decision making in rats

The Psychopharmacology of Effort-Related Decision Making: Dopamine, Adenosine, and Insights into the Neurochemistry of Motivation

Dopamine Antagonism Decreases Willingness to Expend Physical, But Not Cognitive, Effort: A Comparison of Two Rodent Cost/Benefit Decision-Making Tasks

Potential therapeutics for effort-related motivational dysfunction: assessing novel atypical dopamine transport inhibitors

Sex differences in sensitivity to dopamine receptor manipulations of risk-based decision making in rats

Neurobiological foundations and clinical relevance of effort-based decision-making

Sex similarities and dopaminergic differences in interval timing.

Modulation of High Impulsivity and Attentional Performance in Rats by Selective Direct and Indirect Dopaminergic and Noradrenergic Receptor Agonists

Bidirectional modulation of reward-guided decision making by dopamine

Double Dissociation of Serotonergic and Dopaminergic Mechanisms on Attentional Performance Using a Rodent Five-Choice Reaction Time Task

Dopamine and Norepinephrine Differentially Mediate the Exploration-exploitation Tradeoff

Emerging roles of striatal dopamine D2 receptors in motivated behaviour: Implications for psychiatric disorders

Sex differences in oxycodone-taking behaviors are linked to disruptions in reward-guided, decision-making functions

Enhanced Risky Choice in Male Rats Elicited by the Acute Pharmacological Stressor Yohimbine Involves Prefrontal Dopamine D1 Receptor Activation

Effects of the dopamine depleting agent tetrabenazine in tests evaluating different components of depressive-like behavior in mice: sex-dependent response to antidepressant drugs with SERT and DAT blocker profiles

Distinct roles of dopamine and acetylcholine in delay- and effort-based decision making in humans

Dopamine and acetylcholine have distinct roles in delay- and effort-based decision-making in humans

The Role of the Rat Prefrontal Cortex and Sex Differences in Decision-Making

Effort-related functions of nucleus accumbens dopamine and associated forebrain circuits

Limitations of grouping subjects based on biological sex (males versus females) and a new approach: insights from intra-nucleus accumbens core dopamine-induced psychostimulant activity.

Distinct Roles of Dopamine Receptors in the Lateral Thalamus in a Rat Model of Decisional Impulsivity