Abstract:Although previous studies point to qualitative similarities between working memory (WM) and attention, the degree to which these two constructs rely on shared neural mechanisms remains unknown. Focusing on one such potentially shared mechanism, we tested the hypothesis that selecting an item within WM utilizes similar neural mechanisms as selecting a visible item via a shift of attention. We used fMRI and machine learning to decode both the selection among items visually available and the selection among items stored in WM in human subjects (both sexes). Patterns of activity in visual, parietal, and to a lesser extent frontal cortex predicted the locations of the selected items. Critically, these patterns were strikingly interchangeable; classifiers trained on data during attentional selection predicted selection from WM, and classifiers trained on data during selection from memory predicted attentional selection. Using models of voxel receptive fields, we visualized topographic population activity that revealed gain enhancements at the locations of the externally and internally selected items. Our results suggest that selecting among perceived items and selecting among items in WM share a common mechanism. This common mechanism, analogous to a shift of spatial attention, controls the relative gains of neural populations that encode behaviorally relevant information. SIGNIFICANCE STATEMENT How we allocate our attention to external stimuli that we see and to internal representations of stimuli stored in memory might rely on a common mechanism. Supporting this hypothesis, we demonstrated that not only could patterns of human brain activity predict which items were selected during perception and memory, but that these patterns were interchangeable during external and internal selection. Additionally, this generalized selection mechanism operates by changes in the gains of the neural populations both encoding attended sensory representations and storing relevant memory representations.

The attention schema theory in a neural network agent: Controlling visuospatial attention using a descriptive model of attention

Computational characterization of the role of an attention schema in controlling visuospatial attention

Attention Schema in Neural Agents

Attention control and the attention schema theory of consciousness

Common Neural Mechanisms Control Attention and Working Memory

Attention or memory? Neurointerpretable agents in space and time

The Attention Schema Theory: A Foundation for Engineering Artificial Consciousness

A Hierarchical Model of Visual Processing Simulates Neural Mechanisms Underlying Reflexive Attention.

Neural Attention Models in Deep Learning: Survey and Taxonomy

How biological attention mechanisms improve task performance in a large-scale visual system model

A Neural Network Model of Visual Attention Integrating Biased Competition and Reinforcement Learning

The Microstructure of Attentional Control in the Dorsal Attention Network

Attention, please! A survey of neural attention models in deep learning

Learning to attend in a brain-inspired deep neural network

Consciousness and the attention schema: Why it has to be right

Attention in Psychology, Neuroscience, and Machine Learning

Computational modelling of visual attention

On the control of attentional processes in vision

Modelling attention control using a convolutional neural network designed after the ventral visual pathway

A Neurodynamical Theory Of Visual Attention: Comparisons With Fmri- And Single-Neuron Data

Spatial Attention, Feature-Based Attention, and Saccades: Three Sides of One Coin?