Abstract:Although previous studies point to qualitative similarities between working memory (WM) and attention, the degree to which these two constructs rely on shared neural mechanisms remains unknown. Focusing on one such potentially shared mechanism, we tested the hypothesis that selecting an item within WM utilizes similar neural mechanisms as selecting a visible item via a shift of attention. We used fMRI and machine learning to decode both the selection among items visually available and the selection among items stored in WM in human subjects (both sexes). Patterns of activity in visual, parietal, and to a lesser extent frontal cortex predicted the locations of the selected items. Critically, these patterns were strikingly interchangeable; classifiers trained on data during attentional selection predicted selection from WM, and classifiers trained on data during selection from memory predicted attentional selection. Using models of voxel receptive fields, we visualized topographic population activity that revealed gain enhancements at the locations of the externally and internally selected items. Our results suggest that selecting among perceived items and selecting among items in WM share a common mechanism. This common mechanism, analogous to a shift of spatial attention, controls the relative gains of neural populations that encode behaviorally relevant information. SIGNIFICANCE STATEMENT How we allocate our attention to external stimuli that we see and to internal representations of stimuli stored in memory might rely on a common mechanism. Supporting this hypothesis, we demonstrated that not only could patterns of human brain activity predict which items were selected during perception and memory, but that these patterns were interchangeable during external and internal selection. Additionally, this generalized selection mechanism operates by changes in the gains of the neural populations both encoding attended sensory representations and storing relevant memory representations.

Crossmodal Associations and Working Memory in the Brain

Cross-Modal Interaction and Integration Through Stimulus-Specific Adaptation in the Thalamic Reticular Nucleus of Rats.

Interactions between Selective Attention and Visuospatial Working Memory

Neural Correlates of Visuo-Tactile Crossmodal Paired-Associate Learning and Memory in Humans.

Sequential Roles of Primary Somatosensory Cortex and Posterior Parietal Cortex in Tactile-Visual Cross-Modal Working Memory: A Single-Pulse Transcranial Magnetic Stimulation (sptms) Study

Visual Working Memory Organizes Functional Related Objects Beyond the Spatiotemporal Limit

Neural Substrate Of Initiation Of Cross-Modal Working Memory Retrieval

Common Neural Mechanisms Control Attention and Working Memory

Semantic Congruent Audiovisual Integration During the Encoding Stage of Working Memory: an ERP and Sloreta Study

Cross-modal temporal order memory for auditory digits and visual locations: an fMRI study.

The Interplay Between Multisensory Processing and Attention in Working Memory: Behavioral and Neural Indices of Audio-Visual Object Storage

Is the Inter-Item Association in Working Memory Resource Demanding? Rejecting a Dual-Route Model

Overlapping neural representations for selection in attention and working memory

An Excitatory Neural Assembly Encodes Working Memory in the Prefrontal Cortex

Multimodal network dynamics underpinning working memory

Cross-modal and cross-temporal association in neurons of frontal cortex

Propagating cortical waves coordinate sensory encoding and memory retrieval in the human brain

Interactions Between Multisensory Inputs with Voluntary Spatial Attention: an Fmri Study

Excitatory Crossmodal Input to a Widespread Population of Primary Sensory Cortical Neurons

Neural Activities of Tactile Cross-Modal Working Memory in Humans: an Event-Related Potential Study

Theta-alpha cross-frequency synchronization facilitates working memory control – a modeling study