Abstract:Integrating costs and benefits is crucial for optimal decision-making. Although much is known about decisions that involve outcome-related costs (e.g., delay, risk), many of our choices are attached to actions and require an evaluation of the associated motor costs. Yet how the brain incorporates motor costs into choices remains largely unclear. We used human fMRI during choices involving monetary reward and physical effort to identify brain regions that serve as a choice comparator for effort-reward trade-offs. By independently varying both options' effort and reward levels, we were able to identify the neural signature of a comparator mechanism. A network involving supplementary motor area and the caudal portion of dorsal anterior cingulate cortex encoded the difference in reward (positively) and effort levels (negatively) between chosen and unchosen choice options. We next modeled effort-discounted subjective values using a novel behavioral model. This revealed that the same network of regions involving dorsal anterior cingulate cortex and supplementary motor area encoded the difference between the chosen and unchosen options' subjective values, and that activity was best described using a concave model of effort-discounting. In addition, this signal reflected how precisely value determined participants' choices. By contrast, separate signals in supplementary motor area and ventromedial prefrontal cortex correlated with participants' tendency to avoid effort and seek reward, respectively. This suggests that the critical neural signature of decision-making for choices involving motor costs is found in human cingulate cortex and not ventromedial prefrontal cortex as typically reported for outcome-based choice. Furthermore, distinct frontal circuits seem to drive behavior toward reward maximization and effort minimization. Significance statement: The neural processes that govern the trade-off between expected benefits and motor costs remain largely unknown. This is striking because energetic requirements play an integral role in our day-to-day choices and instrumental behavior, and a diminished willingness to exert effort is a characteristic feature of a range of neurological disorders. We use a new behavioral characterization of how humans trade off reward maximization with effort minimization to examine the neural signatures that underpin such choices, using BOLD MRI neuroimaging data. We find the critical neural signature of decision-making, a signal that reflects the comparison of value between choice options, in human cingulate cortex, whereas two distinct brain circuits drive behavior toward reward maximization or effort minimization.

Challenges of Interpreting Frontal Neurons during Value-Based Decision-Making

Evaluating choices by single neurons in the frontal lobe: outcome value encoded across multiple decision variables

Neurons in the frontal lobe encode the value of multiple decision variables

Decision making and reward in frontal cortex: Complementary evidence from neurophysiological and neuropsychological studies.

Neural Signatures of Value Comparison in Human Cingulate Cortex during Decisions Requiring an Effort-Reward Trade-off

Neural correlates of effort-based valuation with prospective choices

Overlapping and Distinct Neural Systems Code for Subjective Value during Intertemporal and Risky Decision Making

Value, pleasure and choice in the ventral prefrontal cortex.

Neuronal mechanisms in prefrontal cortex underlying adaptive choice behavior

Neural correlates of decision variables in parietal cortex

Arbitration between controlled and impulsive choices

Neural reward system reflects individual value comparison strategy in cost-benefit decisions

From Affective Value to Decision-Making in the Prefrontal Cortex

The neural substrates of probabilistic and intertemporal decision making

Single-Neuron Mechanisms Underlying Cost-Benefit Analysis in Frontal Cortex

From Reward Value To Decision-Making: Neuronal And Computational Principles

Reward and decision processes in the brains of humans and nonhuman primates

Temporally organized representations of reward and risk in the human brain

Neural Representations of Post-Decision Accuracy and Reward Expectation in the Caudate Nucleus and Frontal Eye Field

The root of all value: a neural common currency for choice

Corticoinsular circuits encode subjective value expectation and violation for effortful goal-directed behavior