Abstract:Integrating costs and benefits is crucial for optimal decision-making. Although much is known about decisions that involve outcome-related costs (e.g., delay, risk), many of our choices are attached to actions and require an evaluation of the associated motor costs. Yet how the brain incorporates motor costs into choices remains largely unclear. We used human fMRI during choices involving monetary reward and physical effort to identify brain regions that serve as a choice comparator for effort-reward trade-offs. By independently varying both options' effort and reward levels, we were able to identify the neural signature of a comparator mechanism. A network involving supplementary motor area and the caudal portion of dorsal anterior cingulate cortex encoded the difference in reward (positively) and effort levels (negatively) between chosen and unchosen choice options. We next modeled effort-discounted subjective values using a novel behavioral model. This revealed that the same network of regions involving dorsal anterior cingulate cortex and supplementary motor area encoded the difference between the chosen and unchosen options' subjective values, and that activity was best described using a concave model of effort-discounting. In addition, this signal reflected how precisely value determined participants' choices. By contrast, separate signals in supplementary motor area and ventromedial prefrontal cortex correlated with participants' tendency to avoid effort and seek reward, respectively. This suggests that the critical neural signature of decision-making for choices involving motor costs is found in human cingulate cortex and not ventromedial prefrontal cortex as typically reported for outcome-based choice. Furthermore, distinct frontal circuits seem to drive behavior toward reward maximization and effort minimization. Significance statement: The neural processes that govern the trade-off between expected benefits and motor costs remain largely unknown. This is striking because energetic requirements play an integral role in our day-to-day choices and instrumental behavior, and a diminished willingness to exert effort is a characteristic feature of a range of neurological disorders. We use a new behavioral characterization of how humans trade off reward maximization with effort minimization to examine the neural signatures that underpin such choices, using BOLD MRI neuroimaging data. We find the critical neural signature of decision-making, a signal that reflects the comparison of value between choice options, in human cingulate cortex, whereas two distinct brain circuits drive behavior toward reward maximization or effort minimization.

Neural Representations of Post-Decision Accuracy and Reward Expectation in the Caudate Nucleus and Frontal Eye Field

Neuronal representation of the decisional reference point in monkeys

Neural Representation of Cost-Benefit Selections in Medial Prefrontal Cortex of Rats.

Stimulus-dependent adjustment of reward prediction error in the midbrain

Neurons in rat orbitofrontal cortex and medial prefrontal cortex exhibit distinct responses in reward and strategy-update in a risk-based decision-making task

Ongoing, rational calibration of reward-driven perceptual biases

Neural Representation of Cost–benefit Selections in Rat Anterior Cingulate Cortex in Self-Paced Decision Making

A Neural Model of the Frontal Eye Fields with Reward-Based Learning.

Distinct neural manifolds and critical roles of primate caudate nucleus in multimodal decision-making

Dissociable Functions of Reward Inference in the Lateral Prefrontal Cortex and the Striatum

Interaction between decision-making and interoceptive representations of bodily arousal in frontal cortex

Rational inattention in neural coding for economic choice

Neural Signatures of Value Comparison in Human Cingulate Cortex during Decisions Requiring an Effort-Reward Trade-off

Independent circuits in basal ganglia and cortex for the processing of reward and precision feedback

[Reward information encoded by power of local field potentials in the primate prefrontal cortex and striatum].

Differential and temporally dynamic involvement of primate amygdala nuclei in face animacy and reward information processing

Dopamine reward prediction error signal codes the temporal evaluation of a perceptual decision report

Neural dynamics in the orbitofrontal cortex reveal cognitive strategies

Decomposed frontal corticostriatal ensemble activity changes across trials, revealing distinct features relevant to outcome-based decision making

Temporally organized representations of reward and risk in the human brain