Abstract:In a complex and uncertain world, how do we select appropriate behavior? One possibility is that we choose actions that are highly reinforced by their probabilistic consequences (model-free processing). However, we may instead plan actions prior to their actual execution by predicting their consequences (model-based processing). It has been suggested that the brain contains multiple yet distinct systems involved in reward prediction. Several studies have tried to allocate model-free and model-based systems to the striatum and the lateral prefrontal cortex (LPFC), respectively. Although there is much support for this hypothesis, recent research has revealed discrepancies. To understand the nature of the reward prediction systems in the LPFC and the striatum, a series of single-unit recording experiments were conducted. LPFC neurons were found to infer the reward associated with the stimuli even when the monkeys had not yet learned the stimulus-reward (SR) associations directly. Striatal neurons seemed to predict the reward for each stimulus only after directly experiencing the SR contingency. However, the one exception was “Exclusive Or” situations in which striatal neurons could predict the reward without direct experience. Previous single-unit studies in monkeys have reported that neurons in the LPFC encode category information, and represent reward information specific to a group of stimuli. Here, as an extension of these, we review recent evidence that a group of LPFC neurons can predict reward specific to a category of visual stimuli defined by relevant behavioral responses. We suggest that the functional difference in reward prediction between the LPFC and the striatum is that while LPFC neurons can utilize abstract code, striatal neurons can code individual associations between stimuli and reward but cannot utilize abstract code.

Category Inference and Prefrontal Cortex

Reward Prediction Based on Stimulus Categorization in Primate Lateral Prefrontal Cortex

Reward Inference by Primate Prefrontal and Striatal Neurons

Dissociable Functions of Reward Inference in the Lateral Prefrontal Cortex and the Striatum

Reward Prediction in Prefrontal Cortex and Striatum

Category Representation And Generalization In The Prefrontal Cortex

Reward inference by prefrontal neurons

Contributions of distinct prefrontal neuron classes in reward processing

Neural dynamics of causal inference in the macaque frontoparietal circuit

[Reward information encoded by power of local field potentials in the primate prefrontal cortex and striatum].

Differences In Reward Processing Between Putative Cell Types In Primate Prefrontal Cortex

Causal Interaction Between Prefrontal Cortex and Striatum Estimated by Granger Causality

Signal Interaction Between Prefrontal Cortex and Striatum in Reward Prediction

Category Representation in Primary Visual Cortex after Visual Perceptual Learning

Stimulus and reward information encoded by population neurons in the primate prefrontal cortex and striatum

Neural Correlates of Category Learning in Monkey Inferior Temporal Cortex

Ventrolateral prefrontal cortex in macaques guides decisions in different learning contexts

Neurodynamics of the Prefrontal Cortex during Conditional Visuomotor Associations

Quantitative Analysis of Functional Connectivity Between Prefrontal Cortex and Striatum in Monkey

Autocorrelation Structure in the Macaque Dorsolateral, But not Orbital or Polar, Prefrontal Cortex Predicts Response-Coding Strength in a Visually Cued Strategy Task

Cross-modal and cross-temporal association in neurons of frontal cortex