Abstract:Integrating costs and benefits is crucial for optimal decision-making. Although much is known about decisions that involve outcome-related costs (e.g., delay, risk), many of our choices are attached to actions and require an evaluation of the associated motor costs. Yet how the brain incorporates motor costs into choices remains largely unclear. We used human fMRI during choices involving monetary reward and physical effort to identify brain regions that serve as a choice comparator for effort-reward trade-offs. By independently varying both options' effort and reward levels, we were able to identify the neural signature of a comparator mechanism. A network involving supplementary motor area and the caudal portion of dorsal anterior cingulate cortex encoded the difference in reward (positively) and effort levels (negatively) between chosen and unchosen choice options. We next modeled effort-discounted subjective values using a novel behavioral model. This revealed that the same network of regions involving dorsal anterior cingulate cortex and supplementary motor area encoded the difference between the chosen and unchosen options' subjective values, and that activity was best described using a concave model of effort-discounting. In addition, this signal reflected how precisely value determined participants' choices. By contrast, separate signals in supplementary motor area and ventromedial prefrontal cortex correlated with participants' tendency to avoid effort and seek reward, respectively. This suggests that the critical neural signature of decision-making for choices involving motor costs is found in human cingulate cortex and not ventromedial prefrontal cortex as typically reported for outcome-based choice. Furthermore, distinct frontal circuits seem to drive behavior toward reward maximization and effort minimization. Significance statement: The neural processes that govern the trade-off between expected benefits and motor costs remain largely unknown. This is striking because energetic requirements play an integral role in our day-to-day choices and instrumental behavior, and a diminished willingness to exert effort is a characteristic feature of a range of neurological disorders. We use a new behavioral characterization of how humans trade off reward maximization with effort minimization to examine the neural signatures that underpin such choices, using BOLD MRI neuroimaging data. We find the critical neural signature of decision-making, a signal that reflects the comparison of value between choice options, in human cingulate cortex, whereas two distinct brain circuits drive behavior toward reward maximization or effort minimization.

Reward boosts neural coding of task rules to optimise cognitive flexibility

Reward Reinforcement Creates Enduring Facilitation of Goal-directed Behavior

Neurophysiological mechanisms underlying the differential effect of reward prospect on response selection and inhibition

Reward and loss incentives improve spatial working memory by shaping trial-by-trial posterior frontoparietal signals

Synaptic and Spiking Dynamics Underlying Reward Reversal in the Orbitofrontal Cortex.

Reward Value Enhances Sequence Monitoring Ramping Dynamics as Ending Rewards Approach in the Rostrolateral Prefrontal Cortex

The effect of performance contingent reward prospects flexibly adapts to more versus less specific task goals

Ventral tegmental area dopamine neural activity switches simultaneously with rule representations in the prefrontal cortex and hippocampus

Reward, motivation and brain imaging in human healthy participants – A narrative review

How cortico-basal ganglia-thalamic subnetworks can shift decision policies to maximize reward rate

Reward modulates the association between sensory noise and brain activity during perceptual decision-making

Enhancement of cognitive control by approach and avoidance motivational states

Dopamine firing plays a dual role in coding reward prediction errors and signaling motivation in a working memory task

Reward Modulates Unconsciously Triggered Adaptive Control Processes

Reward-driven enhancements in motor control are robust to TMS manipulation

Neural Signatures of Value Comparison in Human Cingulate Cortex during Decisions Requiring an Effort-Reward Trade-off

Trait Reward Sensitivity Modulates Connectivity with the Temporoparietal Junction and Anterior Insula during Strategic Decision Making

Short-term memory capacity predicts willingness to expend cognitive effort for reward

How Instructed Knowledge Modulates the Neural Systems of Reward Learning

Overlapping Neural Systems Represent Cognitive Effort and Reward Anticipation

Adaptive coding of reward in schizophrenia, its change over time and relation to apathy