Abstract:Humans adjust their behavioral strategies based on feedback, a process that may depend on intrinsic preferences and contextual factors such as visual salience. In this study, we hypothesized that decision-making based on visual salience is influenced by habitual and goal-directed processes, which can be evidenced by changes in attention and subjective valuation systems. To test this hypothesis, we conducted a series of studies to investigate the behavioral and neural mechanisms underlying visual salience-driven decision-making. We first established the baseline behavioral strategy without salience in Experiment 1 (n = 21). We then highlighted the utility or performance dimension of the chosen outcome using colors in Experiment 2 (n = 30). We demonstrated that the difference in staying frequency increased along the salient dimension, confirming a salience effect. Furthermore, the salience effect was abolished when directional information was removed in Experiment 3 (n = 28), suggesting that the salience effect is feedback-specific. To generalize our findings, we replicated the feedback-specific salience effects using eye-tracking and text emphasis. The fixation differences between the chosen and unchosen values were enhanced along the feedback-specific salient dimension in Experiment 4 (n = 48) but unchanged after removing feedback-specific information in Experiment 5 (n = 32). Moreover, the staying frequency was correlated with fixation properties, confirming that salience guides attention deployment. Lastly, our neuroimaging study (Experiment 6, n = 25) showed that the striatum subregions encoded salience-based outcome evaluation, while the vmPFC encoded salience-based behavioral adjustments. The connectivity of the vmPFC-ventral striatum accounted for individual differences in utility-driven, whereas the vmPFC-dmPFC for performance-driven behavioral adjustments. Together, our results provide a neurocognitive account of how task-irrelevant visual salience drives decision-making by involving attention and the frontal-striatal valuation systems. PUBLIC SIGNIFICANCE STATEMENT: Humans may use the current outcome to make behavior adjustments. How this occurs may depend on stable individual preferences and contextual factors, such as visual salience. Under the hypothesis that visual salience determines attention and subsequently modulates subjective valuation, we investigated the underlying behavioral and neural bases of visual-context-guided outcome evaluation and behavioral adjustments. Our findings suggest that the reward system is orchestrated by visual context and highlight the critical role of attention and the frontal-striatal neural circuit in visual-context-guided decision-making that may involve habitual and goal-directed processes.

Disrupting optimal decision making in visual foraging: The impact of search experience.

The influence of blocking on feature learning and optimal decision in the visual foraging task.

Optimal Visual Search with Highly Heuristic Decision Rules

Childhood Environmental Unpredictability and Experimentally Primed Uncertainty in Relation to Intuitive versus Deliberate Visual Search

Human visual exploration reduces uncertainty about the sensed world

The relationship between temporal discounting and foraging

Information-seeking in mice (Mus musculus) during visual discrimination: study using a distractor elimination paradigm

Recent Experience-Driven Behaviour Optimizes Foraging

Investigating an effort avoidance account of attentional strategy choice

Navigating the Landscape of Fear

Differential impacts of healthy cognitive aging on directed and random exploration.

Foraging Under Uncertainty Follows the Marginal Value Theorem with Bayesian Updating of Environment Representations

Learning and choosing in an uncertain world: An investigation of the explore-exploit dilemma in static and dynamic environments

Joint contributions of preview and task instructions on visual search strategy selection

Information Search Within a Web Page: Modeling the Full Sequence of Eye Movement Decisions, Subjective Value Updating, and First Clicks

Humans forage for reward in reinforcement learning tasks

History Modulates Early Sensory Processing of Salient Distractors

Pursuit of food versus pursuit of information in a Markovian perception-action loop model of foraging

Employment of time-varying sensory evidence to test the mechanisms underlying flexible decision-making

Bursts and heavy tails in temporal and sequential dynamics of foraging decisions

Cognitive and neural bases of visual-context-guided decision-making