Abstract:Background: An important problem in selective attention is determining the ways the primary visual cortex contributes to the encoding of bottom-up saliency and the types of neural computation that are effective to model this process. To address this problem, we constructed a two-layered network that satisfies the neurobiological constraints of the primary visual cortex to detect salient objects. We carried out experiments on both synthetic images and natural images to explore the influences of different factors, such as network structure, the size of each layer, the type of suppression and the combination strategy, on saliency detection performance. Results: The experimental results statistically demonstrated that the type and scale of filters contribute greatly to the encoding of bottom-up saliency. These two factors correspond to the mechanisms of invariant encoding and overcomplete representation in the primary visual cortex. Conclusions: (1) Instead of constructing Gabor functions or Gaussian pyramids filters for feature extraction as traditional attention models do, we learn overcomplete basis sets from natural images to extract features for saliency detection. Experiments show that given the proper layer size and a robust combination strategy, the learned overcomplete basis set outperforms a complete set and Gabor pyramids in visual saliency detection. This finding can potentially be applied in task-dependent and supervised object detection. (2) A hierarchical coding model that can represent invariant features, is designed for the pre-attentive stage of bottom-up attention. This coding model improves robustness to noises and distractions and improves the ability of detecting salient structures, such as collinear and co-circular structures, and several composite stimuli. This result indicates that invariant representation contributes to saliency detection (popping out) in bottom-up attention. The aforementioned perspectives will significantly contribute to the in-depth understanding of the information processing mechanism in the primary visual system.

Neural activities in v1 create a bottom-up saliency map.

Neural Activities in V1 Create the Bottom-Up Saliency Map of Natural Scenes

Neural Activity in V1 Creates the Saliency Map

The V1 hypothesis—creating a bottom-up saliency map for preattentive selection and segmentation

A Novel Method to Study Bottom-up Visual Saliency and its Neural Mechanism

Psychophysical Tests of the Hypothesis of a Bottom-Up Saliency Map in Primary Visual Cortex.

Measuring the attentional effect of the bottom-up saliency map of natural images

Primary visual cortex as a saliency map: parameter-free prediction of behavior from V1 physiology

An awareness-dependent saliency map in the human visual system

Primary Visual Cortex as a Saliency Map: A Parameter-Free Prediction and Its Test by Behavioral Data.

Some fingerprints of V1 mechanisms in the bottom up saliency for visual selection

Testing The Hypothesis That V1 Creates A Bottom-Up Saliency Map

Bottom-up saliency and top-down learning in the primary visual cortex of monkeys.

Modeling Bottom-Up and Top-Down Attention with a Neurodynamic Model of V1

A neural computational model for bottom-up attention with invariant and overcomplete representation

A Saliency Map in Primary Visual Cortex.

An awareness-dependent mapping of saliency in the human visual system

Parallel Advantage: Further Evidence for Bottom-up Saliency Computation by Human Primary Visual Cortex

Decoding Visual Spatial Attention Control

Neural manifolds in V1 change with top-down signals from V4 targeting the foveal region

Strong Exogenous Attraction to Attention by Unique Eye of Origin -- Evidence for a Bottom-Up Saliency Map in the Primary Visual Cortex