Abstract:Although previous studies point to qualitative similarities between working memory (WM) and attention, the degree to which these two constructs rely on shared neural mechanisms remains unknown. Focusing on one such potentially shared mechanism, we tested the hypothesis that selecting an item within WM utilizes similar neural mechanisms as selecting a visible item via a shift of attention. We used fMRI and machine learning to decode both the selection among items visually available and the selection among items stored in WM in human subjects (both sexes). Patterns of activity in visual, parietal, and to a lesser extent frontal cortex predicted the locations of the selected items. Critically, these patterns were strikingly interchangeable; classifiers trained on data during attentional selection predicted selection from WM, and classifiers trained on data during selection from memory predicted attentional selection. Using models of voxel receptive fields, we visualized topographic population activity that revealed gain enhancements at the locations of the externally and internally selected items. Our results suggest that selecting among perceived items and selecting among items in WM share a common mechanism. This common mechanism, analogous to a shift of spatial attention, controls the relative gains of neural populations that encode behaviorally relevant information. SIGNIFICANCE STATEMENT How we allocate our attention to external stimuli that we see and to internal representations of stimuli stored in memory might rely on a common mechanism. Supporting this hypothesis, we demonstrated that not only could patterns of human brain activity predict which items were selected during perception and memory, but that these patterns were interchangeable during external and internal selection. Additionally, this generalized selection mechanism operates by changes in the gains of the neural populations both encoding attended sensory representations and storing relevant memory representations.

How biological attention mechanisms improve task performance in a large-scale visual system model

Task Optimization Leads to Human-like Top-down and Bottom-up Attention during Reading Comprehension

Attentional Modulation of Neuronal Activity Depends on Neuronal Feature Selectivity

A Neural Network Model of Visual Attention Integrating Biased Competition and Reinforcement Learning

Learning to attend in a brain-inspired deep neural network

Focal vs Diffuse: Mechanisms of attention mediated performance enhancement in a hierarchical model of the visual system

The Costs and Benefits of Goal-Directed Attention in Deep Convolutional Neural Networks

A cortical model with multi-layers to study visual attentional modulation of neurons at the synaptic level

Understanding top-down attention using task-oriented ablation design

Cholinergic Modulation Promotes Attentional Modulation in Primary Visual Cortex- A Modeling Study

A Hierarchical Model of Visual Processing Simulates Neural Mechanisms Underlying Reflexive Attention.

Modeling Attention and Binding in the Brain through Bidirectional Recurrent Gating

Common Neural Mechanisms Control Attention and Working Memory

A Neurodynamical Theory Of Visual Attention: Comparisons With Fmri- And Single-Neuron Data

Leveraging Spiking Deep Neural Networks to Understand the Neural Mechanisms Underlying Selective Attention

Attention in Psychology, Neuroscience, and Machine Learning

Attentional Modulation of Visual Spatial Integration: Psychophysical Evidence Supported by Population Coding Modeling

Object Based Attention Through Internal Gating

Understanding More about Human and Machine Attention in Deep Neural Networks

Guiding Visual Attention in Deep Convolutional Neural Networks Based on Human Eye Movements

Attentional modulation of visual responses by flexible input gain