Abstract:Although previous studies point to qualitative similarities between working memory (WM) and attention, the degree to which these two constructs rely on shared neural mechanisms remains unknown. Focusing on one such potentially shared mechanism, we tested the hypothesis that selecting an item within WM utilizes similar neural mechanisms as selecting a visible item via a shift of attention. We used fMRI and machine learning to decode both the selection among items visually available and the selection among items stored in WM in human subjects (both sexes). Patterns of activity in visual, parietal, and to a lesser extent frontal cortex predicted the locations of the selected items. Critically, these patterns were strikingly interchangeable; classifiers trained on data during attentional selection predicted selection from WM, and classifiers trained on data during selection from memory predicted attentional selection. Using models of voxel receptive fields, we visualized topographic population activity that revealed gain enhancements at the locations of the externally and internally selected items. Our results suggest that selecting among perceived items and selecting among items in WM share a common mechanism. This common mechanism, analogous to a shift of spatial attention, controls the relative gains of neural populations that encode behaviorally relevant information. SIGNIFICANCE STATEMENT How we allocate our attention to external stimuli that we see and to internal representations of stimuli stored in memory might rely on a common mechanism. Supporting this hypothesis, we demonstrated that not only could patterns of human brain activity predict which items were selected during perception and memory, but that these patterns were interchangeable during external and internal selection. Additionally, this generalized selection mechanism operates by changes in the gains of the neural populations both encoding attended sensory representations and storing relevant memory representations.

The role of conjunctive representations in prioritizing and selecting planned actions

Tracking Stimulus Representation Across a 2-Back Visual Working Memory Task

Attentional prioritization reconfigures novel instructions into action-oriented task sets

Involuntary and Voluntary Processes Compete for Entering the Focus of Attention of Working Memory.

Internal attention modulates the functional state of novel stimulus-response associations in working memory

Action Planning Renders Objects in Working Memory More Attentionally Salient

Dynamic prioritisation of sensory and motor contents in working memory

Representing Context and Priority in Working Memory

Common Neural Mechanisms Control Attention and Working Memory

Intention as Hierarchical Constraints in Human Planning

Shared mechanisms underlie the control of working memory and attention

A new aspect of cognitive selectivity: Working memory reselection for attended information

Overlapping neural representations for selection in attention and working memory

Executive and perceptual attention play different roles in visual working memory: evidence from suffix and strategy effects.

Imaging When Acting: Picture but Not Word Cues Induce Action-Related Biases of Visual Attention

Competition for the focus of attention in visual working memory: perceptual recency versus executive control

The neural basis of attentional selection in goal-directed memory retrieval

Concurrent response and action effect representations across the somatomotor cortices during novel task preparation

Proactive and reactive construction of memory-based preferences

Working memory involvement in action planning does not include timing initiation structure

Attention, Short-Term Memory, and Action Selection: A Unifying Theory