Abstract:<p>Most cognitive processes are studied using abstract or synthetic stimuli with specific features to fully control what is presented to subjects. However, recent studies have revealed enhancements of cognitive capacities (such as working memory) when processing naturalistic versus abstract stimuli. Using abstract stimuli constructed from distinct visual features (e.g., color and shape), we have recently shown that human subjects can learn multidimensional stimulus-reward associations via initially estimating reward value of individual features (feature-based learning) before gradually switching to learning about reward value of individual stimuli (object-based learning). Here, we examined whether similar strategies are adopted during learning about naturalistic stimuli that are clearly perceived as objects (instead of a combination of features) and contain both task-relevant and irrelevant features. We found that similar to learning about abstract stimuli, subjects initially adopted feature-based learning more strongly before transitioning to object-based learning. However, there were three key differences between learning about naturalistic and abstract stimuli. First, compared with abstract stimuli, the initial learning strategy was less feature-based for naturalistic stimuli. Second, subjects transitioned to object-based learning faster for naturalistic stimuli. Third, unexpectedly, subjects were more likely to adopt feature-based learning for naturalistic stimuli, both at the steady state and overall. These results suggest that despite the stronger tendency to perceive naturalistic stimuli as objects, which leads to greater likelihood of using object-based learning as the initial strategy and a faster transition to object-based learning, the influence of individual features on learning is stronger for these stimuli such that ultimately the object-based strategy is adopted less. Overall, our findings suggest that feature-based learning is a general initial strategy for learning about reward value of all types of multi-dimensional stimuli.</p>

Your favorite color makes learning more precise and adaptable

Learning arbitrary stimulus-reward associations for naturalistic stimuli involves transition from learning about features to learning about objects

Contributions of attention to learning in multidimensional reward environments

Learning Shapes the Representation of Behavioral Choice in the Human Brain

Contributions of statistical learning to learning from reward feedback

Neural mechanisms of distributed value representations and learning strategies

An inductive bias for slowly changing features in human reinforcement learning

Human value learning and representation reflect rational adaptation to task demands

Learning attentional templates for value-based decision-making

Computational mechanisms of distributed value representations and mixed learning strategies

Dynamic Interaction between Reinforcement Learning and Attention in Multidimensional Environments

Pragmatic Feature Preferences: Learning Reward-Relevant Preferences from Human Input

Learning to Choose: Behavioral Dynamics Underlying the Initial Acquisition of Decision Making

Ongoing, rational calibration of reward-driven perceptual biases

Hidden Reward: Affect and Its Prediction Errors as Windows Into Subjective Value

Learning to Choose: Behavioral Dynamics Underlying the Initial Acquisition of Decision-Making

Better than maximum likelihood estimation of model-based and model-free learning style

Humans rationally balance detailed and temporally abstract world models

Learning Shapes Spatiotemporal Brain Patterns for Flexible Categorical Decisions

Adaptive Integration of Perceptual and Reward Information in an Uncertain World

Asymmetrical adaptations to increases and decreases in environmental volatility