Abstract:Strategic interactions, where an individual's payoff depends on the decisions of multiple intelligent agents, are ubiquitous among social animals. They span a variety of important social behaviors such as competition, cooperation, coordination, and communication, and often involve complex, intertwining cognitive operations ranging from basic reward processing to higher-order mentalization. Here, we review the progress and challenges in probing the neural and cognitive mechanisms of strategic behavior of interacting individuals, drawing an analogy to recent developments in studies of reward-seeking behavior, in particular, how research focuses in the field of strategic behavior have been expanded from adaptive behavior based on trial-and-error to flexible decisions based on limited prior experience. We highlight two important research questions in the field of strategic behavior: (i) How does the brain exploit past experience for learning to behave strategically? and (ii) How does the brain decide what to do in novel strategic situations in the absence of direct experience? For the former, we discuss the utility of learning models that have effectively connected various types of neural data with strategic learning behavior and helped elucidate the interplay among multiple learning processes. For the latter, we review the recent evidence and propose a neural generative mechanism by which the brain makes novel strategic choices through simulating others' goal-directed actions according to rational or bounded-rational principles obtained through indirect social knowledge. This article is categorized under: Economics > Interactive Decision-Making Psychology > Reasoning and Decision Making Neuroscience > Cognition.

Neural mechanisms of distributed value representations and learning strategies

Computational mechanisms of distributed value representations and mixed learning strategies

Temporally organized representations of reward and risk in the human brain

The network architecture of value learning

A neural mechanism for conserved value computations integrating information and rewards

Overlapping and Distinct Neural Systems Code for Subjective Value during Intertemporal and Risky Decision Making

A neuronal prospect theory model in the brain reward circuitry

A distributional code for value in dopamine-based reinforcement learning

Exploration-exploitation mechanisms in recurrent neural networks and human learners in restless bandit problems

Neural networks with motivation

The Neural Dynamics of Reward Value and Risk Coding in the Human Orbitofrontal Cortex.

Neurocomputations of strategic behavior: From iterated to novel interactions

Contributions of attention to learning in multidimensional reward environments

The root of all value: a neural common currency for choice

Dopamine prediction error responses integrate subjective value from different reward dimensions

How Instructed Knowledge Modulates the Neural Systems of Reward Learning

Dissociable Neural Representations of Reinforcement and Belief Prediction Errors Underlie Strategic Learning

Brain mechanism of foraging: Reward-dependent synaptic plasticity versus neural integration of values

Your favorite color makes learning more precise and adaptable

Neural dynamics of reversal learning in the prefrontal cortex and recurrent neural networks