Abstract:Abstract Human behavior is strongly driven by the pursuit of rewards. In daily life, however, benefits mostly come at a cost, often requiring that effort be exerted to obtain potential benefits. Medial PFC (MPFC) and dorsolateral PFC (DLPFC) are frequently implicated in the expectation of effortful control, showing increased activity as a function of predicted task difficulty. Such activity partially overlaps with expectation of reward and has been observed both during decision-making and during task preparation. Recently, novel computational frameworks have been developed to explain activity in these regions during cognitive control, based on the principle of prediction and prediction error (predicted response–outcome [PRO] model [Alexander, W. H., & Brown, J. W. Medial prefrontal cortex as an action-outcome predictor. Nature Neuroscience, 14, 1338–1344, 2011], hierarchical error representation [HER] model [Alexander, W. H., & Brown, J. W. Hierarchical error representation: A computational model of anterior cingulate and dorsolateral prefrontal cortex. Neural Computation, 27, 2354–2410, 2015]). Despite the broad explanatory power of these models, it is not clear whether they can also accommodate effects related to the expectation of effort observed in MPFC and DLPFC. Here, we propose a translation of these computational frameworks to the domain of effort-based behavior. First, we discuss how the PRO model, based on prediction error, can explain effort-related activity in MPFC, by reframing effort-based behavior in a predictive context. We propose that MPFC activity reflects monitoring of motivationally relevant variables (such as effort and reward), by coding expectations and discrepancies from such expectations. Moreover, we derive behavioral and neural model-based predictions for healthy controls and clinical populations with impairments of motivation. Second, we illustrate the possible translation to effort-based behavior of the HER model, an extended version of PRO model based on hierarchical error prediction, developed to explain MPFC–DLPFC interactions. We derive behavioral predictions that describe how effort and reward information is coded in PFC and how changing the configuration of such environmental information might affect decision-making and task performance involving motivation.

Neural substrates of the interaction between effort-expenditure reward decision-making and outcome anticipation

Effort provides its own reward: endeavors reinforce subjective expectation and evaluation of task performance

Electrophysiological Mechanisms in the Anterior Insula Cortex during Reward Expectancy

Overlapping Neural Systems Represent Cognitive Effort and Reward Anticipation

The neural correlates underlying the regulation of anticipation on regret

Neural correlates of effort-based valuation with prospective choices

Anticipatory Pleasure Predicts Effective Connectivity in the Mesolimbic System.

Neural substrates underlying the expectation of rewards resulting from effortful exertion

Neural Substrates of the Impaired Effort Expenditure Decision Making in Schizophrenia.

Neurobiological foundations and clinical relevance of effort-based decision-making

Neural basis of reward expectancy inducing proactive aggression

The neural substrates of probabilistic and intertemporal decision making

Love is analogous to money in human brain: Coordinate-based and functional connectivity meta-analyses of social and monetary reward anticipation

Predicting Motivation: Computational Models of PFC Can Explain Neural Coding of Motivation and Effort-based Decision-making in Health and Disease

Elevated outcome-anticipation and outcome-evaluation ERPs associated with a greater preference for larger-but-delayed rewards

Neural Activities Underlying the Feedback Express Salience Prediction Errors for Appetitive and Aversive Stimuli

Rapid Processing of Both Reward Probability and Reward Uncertainty in the Human Anterior Cingulate Cortex

The Neural Predictors of Choice Preference in Intertemporal Choice

Expectations of immediate and delayed reward differentially affect cognitive task performance

Neural Mechanisms Underlying Time Perception and Reward Anticipation

Reward and expectancy effects on neural signals of motor preparation and execution