Abstract:Flexibly adjusting our behavioral strategies based on the environmental context is critical to maximize rewards. Ventrolateral prefrontal cortex (vlPFC) has been implicated in both learning and decision-making for probabilistic rewards, although how context influences these processes remains unclear. We collected functional neuroimaging data while rhesus macaques performed a probabilistic learning task in two contexts: one with novel and another with familiar visual stimuli. We found that activity in vlPFC encoded rewards irrespective of the context but encoded behavioral strategies that depend on reward outcome (win-stay/lose-shift) preferentially in novel contexts. Functional connectivity between vlPFC and anterior cingulate cortex varied with behavioral strategy in novel learning blocks. By contrast, connectivity between vlPFC and mediodorsal thalamus was highest when subjects repeated a prior choice. Furthermore, pharmacological D2-receptor blockade altered behavioral strategies during learning and resting-state vlPFC activity. Taken together, our results suggest that multiple vlPFC-linked circuits contribute to adaptive decision-making in different contexts.

What problem does this paper attempt to address?

The problem that this paper attempts to solve is to understand how primates (taking rhesus monkeys as an example) adjust their behavioral strategies in different learning situations, especially the decision - making process in uncertain environments. Specifically, the research focuses on the role played by the ventrolateral prefrontal cortex (vlPFC) in guiding learning tasks based on reward probability, and how it encodes reward outcomes and behavioral strategies according to different learning situations (new situations and familiar situations). ### Research Background - **Flexible Behavioral Adjustment**: In order to obtain the best results, organisms must be able to flexibly adjust their behaviors according to environmental changes. For example, choosing the most reliable means of transportation to reach the airport in different cities. - **The Impact of Failure**: The lack of such flexibility may lead to serious consequences. For example, patients with gambling disorder continue to engage in high - risk behaviors due to a lack of cognitive flexibility, or schizophrenic patients make inflexible decisions based on delusional beliefs. ### Research Objectives - **The Role of vlPFC**: The research aims to explore the role of vlPFC in different learning situations, especially how it supports adaptive decision - making through its interaction with other brain regions. - **Behavioral Strategies**: The research also focuses on the application of the "win - stay/lose - shift" (WSLS) behavioral strategy in different learning situations and its impact on task performance. ### Experimental Design - **Experimental Subjects**: Four rhesus monkeys. - **Task Types**: Monkeys make choices in a probability - learning task to obtain liquid rewards. The task is divided into two situations: a new situation (using visual stimuli that have never been seen before) and a familiar situation (using visual stimuli that have been learned before). - **Data Collection**: Functional magnetic resonance imaging (fMRI) is used to record the brain activities of monkeys when they are performing the task. ### Main Findings - **Behavioral Adaptation**: Monkeys gradually improve their task performance in new situations, while always maintaining a relatively high performance level in familiar situations. - **Strategy Use**: Monkeys show different behavioral strategies in different situations, especially being more inclined to use the WSLS strategy in familiar situations. - **Brain Activity**: The activity of vlPFC not only encodes reward outcomes but also encodes behavioral strategies especially in new situations. In addition, the functional connection between vlPFC and the anterior cingulate cortex (ACC) changes with the change of behavioral strategies in new situations. ### Conclusions - **Multiple Roles of vlPFC**: The research results show that vlPFC plays different functions in different learning situations through its interaction with different brain regions, thus supporting the adaptive decision - making process. - **The Importance of Behavioral Strategies**: The correct application of behavioral strategies based on reward outcomes is crucial for improving task performance, especially in new situations. In general, this research reveals how vlPFC encodes reward outcomes and behavioral strategies in different learning situations and how these encodings affect the decision - making process. This provides important insights into understanding the decision - making mechanisms of primates in uncertain environments.

Ventrolateral prefrontal cortex in macaques guides decisions in different learning contexts

Dissociable representations of decision variables within subdivisions of macaque orbitofrontal and ventrolateral frontal cortex

Dissociable Representations of Decision Variables within Subdivisions of the Macaque Orbital and Ventrolateral Frontal Cortex

Decision-making shapes dynamic inter-areal communication within macaque ventral frontal cortex

Specializations for reward-guided decision-making in the primate ventral prefrontal cortex

Ventral tegmental area dopamine neural activity switches simultaneously with rule representations in the prefrontal cortex and hippocampus

Dorsolateral prefrontal cortex drives strategic aborting by optimizing long-run policy extraction

Context-invariant beliefs are supported by dynamic reconfiguration of single unit functional connectivity in prefrontal cortex of male macaques

Connectivity reveals relationship of brain areas for reward-guided learning and decision making in human and monkey frontal cortex

Prefrontal top-down projections control context-dependent strategy selection

Abstraction of Reward Context Facilitates Relative Reward Coding in Neural Populations of the Macaque Anterior Cingulate Cortex

Prefrontal cortex temporally multiplexes slow and fast dynamics in value learning and memory

From conflict management to reward-based decision making: actors and critics in primate medial frontal cortex

Pharmacological modulation of dopamine D1 and D2 receptors reveals distinct neural networks related to probabilistic learning in non-human primates.

Neurons in rat orbitofrontal cortex and medial prefrontal cortex exhibit distinct responses in reward and strategy-update in a risk-based decision-making task

Functional role of the ventrolateral prefrontal cortex in decision making.

Dissociable Functions of Reward Inference in the Lateral Prefrontal Cortex and the Striatum

Distinct roles of monkey OFC-subcortical pathways in adaptive behavior

Balancing risk-return decisions by manipulating the mesofrontal circuits in primates

Prefrontal cell activities related to monkeys' success and failure in adapting to rule changes in a Wisconsin Card Sorting Test analog

Reward Prediction Based on Stimulus Categorization in Primate Lateral Prefrontal Cortex