Abstract:Integrating costs and benefits is crucial for optimal decision-making. Although much is known about decisions that involve outcome-related costs (e.g., delay, risk), many of our choices are attached to actions and require an evaluation of the associated motor costs. Yet how the brain incorporates motor costs into choices remains largely unclear. We used human fMRI during choices involving monetary reward and physical effort to identify brain regions that serve as a choice comparator for effort-reward trade-offs. By independently varying both options' effort and reward levels, we were able to identify the neural signature of a comparator mechanism. A network involving supplementary motor area and the caudal portion of dorsal anterior cingulate cortex encoded the difference in reward (positively) and effort levels (negatively) between chosen and unchosen choice options. We next modeled effort-discounted subjective values using a novel behavioral model. This revealed that the same network of regions involving dorsal anterior cingulate cortex and supplementary motor area encoded the difference between the chosen and unchosen options' subjective values, and that activity was best described using a concave model of effort-discounting. In addition, this signal reflected how precisely value determined participants' choices. By contrast, separate signals in supplementary motor area and ventromedial prefrontal cortex correlated with participants' tendency to avoid effort and seek reward, respectively. This suggests that the critical neural signature of decision-making for choices involving motor costs is found in human cingulate cortex and not ventromedial prefrontal cortex as typically reported for outcome-based choice. Furthermore, distinct frontal circuits seem to drive behavior toward reward maximization and effort minimization. Significance statement: The neural processes that govern the trade-off between expected benefits and motor costs remain largely unknown. This is striking because energetic requirements play an integral role in our day-to-day choices and instrumental behavior, and a diminished willingness to exert effort is a characteristic feature of a range of neurological disorders. We use a new behavioral characterization of how humans trade off reward maximization with effort minimization to examine the neural signatures that underpin such choices, using BOLD MRI neuroimaging data. We find the critical neural signature of decision-making, a signal that reflects the comparison of value between choice options, in human cingulate cortex, whereas two distinct brain circuits drive behavior toward reward maximization or effort minimization.

Neural mechanisms of information seeking

A neural mechanism for conserved value computations integrating information and rewards

Neural reward system reflects individual value comparison strategy in cost-benefit decisions

A neural code supporting prospective probabilistic reasoning for instrumental information demand in humans

Neural and Computational Mechanisms of Motivation and Decision-making

The root of all value: a neural common currency for choice

Neural correlates of valence-dependent belief and value updating during uncertainty reduction: an fNIRS study

The effect of noninstrumental information on reward learning

Curiosity: primate neural circuits for novelty and information seeking

A Thirst for Knowledge: Grounding Curiosity, Creativity, and Aesthetics in Memory and Reward Neural Systems

Reward and decision processes in the brains of humans and nonhuman primates

Who Will You Ask? an Empirical Study of Interpersonal Task Information Seeking

The Neural Correlates of Decision-Making: Review and Research Agenda

Representations of the intrinsic value of information in mouse orbitofrontal cortex

Challenges of Interpreting Frontal Neurons during Value-Based Decision-Making

Neuronal mechanisms in prefrontal cortex underlying adaptive choice behavior

Motivational drivers of costly information search

Representation of Anticipated Rewards and Punishments in the Human Brain

Brain mechanism of foraging: Reward-dependent synaptic plasticity versus neural integration of values

Neural Signatures of Value Comparison in Human Cingulate Cortex during Decisions Requiring an Effort-Reward Trade-off

How Instructed Knowledge Modulates the Neural Systems of Reward Learning