Abstract:Visual Working Memory (VWM) stores visual information for upcoming actions. Just as attention can shift externally towards relevant objects in the visual environment, attention can shift internally towards (i.e., prioritize) VWM content that is relevant for upcoming tasks. Internal and external attentional selection share a number of key neural and functional characteristics, which include their spatial organization: recent work has shown that spatial attention is directed towards the previous location of a prioritized memory item, similar to how a perceived stimulus is prioritized. Attending stimuli that are physically present is useful, as it enhances processing of the relevant visual input. When prioritizing items in memory, however, attending the prior stimulus location cannot serve this purpose, as there is no visual input to enhance. Here, we address this apparent contradiction which highlights the gaps in our understanding of the mechanisms underlying external and internal visual attention. In two EEG experiments, we compare location-specific sensory enhancement during the attentional selection of external (perceived) as compared to internal (memorized) stimuli. During both internal and external selection we observed a lateralization of alpha oscillations and gaze position bias toward the previous locations of prioritized items, confirming earlier findings that suggested an inherent spatial organization within VWM. Critically, using Rapid Invisible Frequency Tagging (RIFT), we show that sensory enhancement at the attended location is only observed during external attentional selection of (perceived) stimuli. No such location-specific sensory enhancement was observed during attentional selection of items in VWM. Furthermore, we found no clear relationship across trials between alpha lateralization and sensory enhancement (measured through RIFT) during external attention, suggesting that these two metrics indeed reflect distinct cognitive mechanisms. In sum, using a novel combination of EEG and RIFT, we demonstrate a fundamental distinction between the neural mechanisms underlying the selection of perceived and memorized objects. Both types of selection operate within a spatial reference frame, but only external selection modulates early sensory processing. Our findings suggest that the visual system is not vestigially recruiting existing mechanisms of external attention for prioritization in VWM, but is instead using space as an organizational principle to store and select items in VWM.

Value-driven Attentional Capture is Stronger for Internal than External Stimuli

Previously Reward-Associated Stimuli Capture Spatial Attention in the Absence of Changes in the Corresponding Sensory Representations as Measured with MEG

Dimension-based working memory-driven capture of visual selection.

Dissociable neural mechanisms underlie value-driven and selection-driven attentional capture

Dissociated roles of the parietal and frontal cortices in the scope and control of attention during visual working memory.

The Effect of Working Memory Load on Attentional Capture

The modulation of value-driven attentional capture by exploration for reward information.

Manipulating the reliability of target-color information modulates value-driven attentional capture

Neural correlates of reward-driven attentional capture in visual search

Perceptual Gating of Value-Driven Attentional Capture

Interaction Between Value and Perceptual Salience in Value-Driven Attentional Capture.

Reward Captures Attention Independent of the Current Focus of Attention

Reward-modulated attention deployment is driven by suppression, not attentional capture

Reward Association Facilitates Distractor Suppression in Human Visual Search

Loss of precise auditory sampling as a sign of value-driven visual attentional capture

Learned Reward Association Improves Visual Working Memory.

Reward Prompts Visual Short-Term Memory Consolidation

Selectively Maintaining Object Features Within Visual Working Memory: an ERP Study

Rewarding outcomes enhance attentional capture and delay attentional disengagement.

Dissociating External and Internal Attentional Selection

Attention without working memory: A feature-specific working memory gate for attended information