Abstract:In many everyday decisions, individuals choose between trialling something novel or something they know well. Deciding when to try a new option or stick with an option that is already known to you, known as the "explore/exploit" dilemma, is an important feature of cognition that characterises a range of decision-making contexts encountered by humans. Recent evidence has suggested preferences in explore/exploit biases are associated with psychopathology, although this has typically been examined within individual disorders. The current review examined whether explore/exploit decision-making represents a promising transdiagnostic target for psychosis, depression, and anxiety. A systematic search of academic databases was conducted, yielding a total of 29 studies. Studies examining psychosis were mostly consistent in showing that individuals with psychosis explored more compared with individuals without psychosis. The literature on anxiety and depression was more heterogenous; some studies found that anxiety and depression were associated with more exploration, whereas other studies demonstrated reduced exploration in anxiety and depression. However, examining a subset of studies that employed case-control methods, there was some evidence that both anxiety and depression also were associated with increased exploration. Due to the heterogeneity across the literature, we suggest that there is insufficient evidence to conclude whether explore/exploit decision-making is a transdiagnostic target for psychosis, depression, and anxiety. However, alongside our advisory groups of lived experience advisors, we suggest that this context of decision-making is a promising candidate that merits further investigation using well-powered, longitudinal designs. Such work also should examine whether biases in explore/exploit choices are amenable to intervention.

The structure and development of explore-exploit decision making

Learning and choosing in an uncertain world: An investigation of the explore-exploit dilemma in static and dynamic environments

Exploration, exploitation, and development: Developmental shifts in decision‐making

Exploration Unbound

Humans adaptively resolve the explore-exploit dilemma under cognitive constraints: Evidence from a multi-armed bandit task

To explore or exploit: Individual differences in preschool decision making

Childhood unpredictability and the development of exploration

Social Learning and the Exploration-Exploitation Tradeoff

Novelty and uncertainty differentially drive exploration across development

Curiosity and the dynamics of optimal exploration

Regulatory fit and systematic exploration in a dynamic decision-making environment.

Chasing a Moving Target: Exploitation and Exploration in Dynamic Environments

Exploratory Learning and Exploitative Learning in Different Organizational Structures

Reviewing explore/exploit decision-making as a transdiagnostic target for psychosis, depression, and anxiety

Value-free random exploration is linked to impulsivity

The Exploration-Exploitation Dilemma Revisited: An Entropy Perspective

A Behavioral Model for Exploration vs. Exploitation: Theoretical Framework and Experimental Evidence

Exploration–Exploitation Duality with Both Tradeoff and Synergy: the Curvilinear Interaction Effects of Learning Modes on Innovation Types

Balancing safety and efficiency in human decision making

Uncertainty quantification and exploration-exploitation trade-off in humans

Disentangling Exploration from Exploitation