Abstract:Priority map theory is a leading framework for understanding how various aspects of stimulus displays and task demands guide visual attention. Per this theory, the visual system computes a priority map, which is a representation of visual space indexing the relative importance, or priority, of locations in the environment. Priority is computed based on both salience, defined based on image-computable properties; and relevance, defined by an individual's current goals, and is used to direct attention to the highest-priority locations for further processing. Computational theories suggest that priority maps identify salient locations based on individual feature dimensions (e.g., color, motion), which are integrated into an aggregate priority map. While widely accepted, a core assumption of this framework, the existence of independent feature dimension maps in visual cortex, remains untested. Here, we tested the hypothesis that retinotopic regions selective for specific feature dimensions (color or motion) in human cortex act as neural feature dimension maps, indexing salient locations based on their preferred feature. We used fMRI activation patterns to reconstruct spatial maps while male and female human participants viewed stimuli with salient regions defined by relative color or motion direction. Activation in reconstructed spatial maps was localized to the salient stimulus position in the display. Moreover, the strength of the stimulus representation was strongest in the ROI selective for the salience-defining feature. Together, these results suggest that feature-selective extrastriate visual regions highlight salient locations based on local feature contrast within their preferred feature dimensions, supporting their role as neural feature dimension maps.SIGNIFICANCE STATEMENT Identifying salient information is important for navigating the world. For example, it is critical to detect a quickly approaching car when crossing the street. Leading models of computer vision and visual search rely on compartmentalized salience computations based on individual features; however, there has been no direct empirical demonstration identifying neural regions as responsible for performing these dissociable operations. Here, we provide evidence of a critical double dissociation that neural activation patterns from color-selective regions prioritize the location of color-defined salience while minimally representing motion-defined salience, whereas motion-selective regions show the complementary result. These findings reveal that specialized cortical regions act as neural "feature dimension maps" that are used to index salient locations based on specific features to guide attention.

A Saliency Map in Primary Visual Cortex.

Primary Visual Cortex as a Saliency Map: A Parameter-Free Prediction and Its Test by Behavioral Data.

Primary visual cortex as a saliency map: parameter-free prediction of behavior from V1 physiology

Psychophysical Tests of the Hypothesis of a Bottom-Up Saliency Map in Primary Visual Cortex.

Neural Activity in V1 Creates the Saliency Map

The V1 hypothesis—creating a bottom-up saliency map for preattentive selection and segmentation

A Theory of a Saliency Map in Primary Visual Cortex (V1) Tested by Psychophysics of Colour–orientation Interference in Texture Segmentation

Testing The Hypothesis That V1 Creates A Bottom-Up Saliency Map

Contour Saliency in Primary Visual Cortex

Topographical Representation of Saliency in the Human Visual and Temporo-occipital Cortex

Understanding Conjunction and Double Feature Searches by a Saliency Map in Primary Visual Cortex

A Computational Coding Model for Saliency Detection in Primary Visual Cortex

A saliency map method with cortex-like mechanisms and sparse representation

Feature-Specific Salience Maps in Human Cortex

From the Optic Tectum to the Primary Visual Cortex: Migration Through Evolution of the Saliency Map for Exogenous Attentional Guidance

A Psychophysically Oriented Saliency Map Prediction Model

Saliency Based on Cortex-Like Mechanisms.

A Biological Inspired Features Based Saliency Map

Superior colliculus encodes visual saliency before the primary visual cortex

Neural activities in v1 create a bottom-up saliency map.

Pre-Attentive Segmentation in the Primary Visual Cortex