Abstract:Priority map theory is a leading framework for understanding how various aspects of stimulus displays and task demands guide visual attention. Per this theory, the visual system computes a priority map, which is a representation of visual space indexing the relative importance, or priority, of locations in the environment. Priority is computed based on both salience, defined based on image-computable properties; and relevance, defined by an individual's current goals, and is used to direct attention to the highest-priority locations for further processing. Computational theories suggest that priority maps identify salient locations based on individual feature dimensions (e.g., color, motion), which are integrated into an aggregate priority map. While widely accepted, a core assumption of this framework, the existence of independent feature dimension maps in visual cortex, remains untested. Here, we tested the hypothesis that retinotopic regions selective for specific feature dimensions (color or motion) in human cortex act as neural feature dimension maps, indexing salient locations based on their preferred feature. We used fMRI activation patterns to reconstruct spatial maps while male and female human participants viewed stimuli with salient regions defined by relative color or motion direction. Activation in reconstructed spatial maps was localized to the salient stimulus position in the display. Moreover, the strength of the stimulus representation was strongest in the ROI selective for the salience-defining feature. Together, these results suggest that feature-selective extrastriate visual regions highlight salient locations based on local feature contrast within their preferred feature dimensions, supporting their role as neural feature dimension maps.SIGNIFICANCE STATEMENT Identifying salient information is important for navigating the world. For example, it is critical to detect a quickly approaching car when crossing the street. Leading models of computer vision and visual search rely on compartmentalized salience computations based on individual features; however, there has been no direct empirical demonstration identifying neural regions as responsible for performing these dissociable operations. Here, we provide evidence of a critical double dissociation that neural activation patterns from color-selective regions prioritize the location of color-defined salience while minimally representing motion-defined salience, whereas motion-selective regions show the complementary result. These findings reveal that specialized cortical regions act as neural "feature dimension maps" that are used to index salient locations based on specific features to guide attention.

Topographical Representation of Saliency in the Human Visual and Temporo-occipital Cortex

Salient Locations Search Based on Human Visual Attention: an Experimental Analysis

Visual Saliency Detection Based on Topographic Independent Component Analysis

A Saliency Map in Primary Visual Cortex.

Feature-Specific Salience Maps in Human Cortex

A saliency map method with cortex-like mechanisms and sparse representation

Saliency Based on Cortex-Like Mechanisms.

An awareness-dependent saliency map in the human visual system

An awareness-dependent mapping of saliency in the human visual system

Understanding Conjunction and Double Feature Searches by a Saliency Map in Primary Visual Cortex

Saliency Detection Inspired by Topological Perception Theory

A Novel Approach for Visual Saliency Detection and Segmentation Based on Objectness and Top-Down Attention

Neural Activity in V1 Creates the Saliency Map

Computational modelling of visual attention

Cortical dynamics of contextually cued attentive visual learning and search: Spatial and object evidence accumulation.

A Novel Method to Study Bottom-up Visual Saliency and its Neural Mechanism

Properties of V1 Neurons Tuned to Conjunctions of Visual Features: Application of the V1 Saliency Hypothesis to Visual Search Behavior.

Selective Visual Attention Revealed by Integrating FMRI and Eye-Tracking

Tag-Saliency: Combining Bottom-Up and Top-Down Information for Saliency Detection

Visual Saliency As Sequential Eye Fixation Probability

Saliency Detection in Complex Scenes.