Abstract:In a complex and uncertain world, how do we select appropriate behavior? One possibility is that we choose actions that are highly reinforced by their probabilistic consequences (model-free processing). However, we may instead plan actions prior to their actual execution by predicting their consequences (model-based processing). It has been suggested that the brain contains multiple yet distinct systems involved in reward prediction. Several studies have tried to allocate model-free and model-based systems to the striatum and the lateral prefrontal cortex (LPFC), respectively. Although there is much support for this hypothesis, recent research has revealed discrepancies. To understand the nature of the reward prediction systems in the LPFC and the striatum, a series of single-unit recording experiments were conducted. LPFC neurons were found to infer the reward associated with the stimuli even when the monkeys had not yet learned the stimulus-reward (SR) associations directly. Striatal neurons seemed to predict the reward for each stimulus only after directly experiencing the SR contingency. However, the one exception was “Exclusive Or” situations in which striatal neurons could predict the reward without direct experience. Previous single-unit studies in monkeys have reported that neurons in the LPFC encode category information, and represent reward information specific to a group of stimuli. Here, as an extension of these, we review recent evidence that a group of LPFC neurons can predict reward specific to a category of visual stimuli defined by relevant behavioral responses. We suggest that the functional difference in reward prediction between the LPFC and the striatum is that while LPFC neurons can utilize abstract code, striatal neurons can code individual associations between stimuli and reward but cannot utilize abstract code.

Reward inference by prefrontal neurons

Category Inference and Prefrontal Cortex

Event-related potential measures of the intending process: Time course and related ERP components

Neural signs of flexible categorization: evidence from the flexibility of inclusion of humans in animal/non-animal categorization.

Cognitive changes in conjunctive rule-based category learning: An ERP approach

Visual Object Categorization from Whole to Fine: Evidence from ERP

ERP Component Analysis for Rapid Image Searching in Finer Categories

Reward Prediction Based on Stimulus Categorization in Primate Lateral Prefrontal Cortex

Electrophysiological correlates of category induction: PSW amplitude as an index of identifying shared attributes.

N400 as an index of uncontrolled categorization processing in brand extension.

Two-stage Categorization in Brand Extension Evaluation: Electrophysiological Time Course Evidence.

Dissociable Functions of Reward Inference in the Lateral Prefrontal Cortex and the Striatum

Reward Enhances Cross-Modal Conflict Control in Object Categorization: Electrophysiological Evidence

Endogenous Attention Affects Decision-related Neural Activity but Not Afferent Visual Responses

The role of category label in adults' inductive reasoning

Reward expectation modulates N2pc for target selection: Electrophysiological evidence

Registered Report Stage II: Decoding the category information from evoked potentials to visible and invisible visual objects

Category learning can alter perception and its neural correlates

P300 and categorization in brand extension.

The Timing of Cognitive Control in Partially Incongruent Categorization

Cognitive and Neural Mechanisms of Category-based Feature Inference