Abstract:Background: An important problem in selective attention is determining the ways the primary visual cortex contributes to the encoding of bottom-up saliency and the types of neural computation that are effective to model this process. To address this problem, we constructed a two-layered network that satisfies the neurobiological constraints of the primary visual cortex to detect salient objects. We carried out experiments on both synthetic images and natural images to explore the influences of different factors, such as network structure, the size of each layer, the type of suppression and the combination strategy, on saliency detection performance. Results: The experimental results statistically demonstrated that the type and scale of filters contribute greatly to the encoding of bottom-up saliency. These two factors correspond to the mechanisms of invariant encoding and overcomplete representation in the primary visual cortex. Conclusions: (1) Instead of constructing Gabor functions or Gaussian pyramids filters for feature extraction as traditional attention models do, we learn overcomplete basis sets from natural images to extract features for saliency detection. Experiments show that given the proper layer size and a robust combination strategy, the learned overcomplete basis set outperforms a complete set and Gabor pyramids in visual saliency detection. This finding can potentially be applied in task-dependent and supervised object detection. (2) A hierarchical coding model that can represent invariant features, is designed for the pre-attentive stage of bottom-up attention. This coding model improves robustness to noises and distractions and improves the ability of detecting salient structures, such as collinear and co-circular structures, and several composite stimuli. This result indicates that invariant representation contributes to saliency detection (popping out) in bottom-up attention. The aforementioned perspectives will significantly contribute to the in-depth understanding of the information processing mechanism in the primary visual system.

A Computational Model of Selecting Visual Attention Based on Bottom-Up and Top-Down Feature Combination

A visual attention model combining top-down and bottom-up mechanisms for salient object detection

The Interaction between Space-based and Object-based Visual Selection

Modeling Of Top-Down Influences On Object-Based Visual Attention For Robots

Computational Model for Machine Vision Inspection Based on Vision Attention

The Research of Bottom-Up and Top-Down Combination Visual Attention Calculative Method

A VISUAL ATTENTION MODEL FOR NATURAL SCENES BASED ON DYNAMIC FEATURE COMBINATION

A neural computational model for bottom-up attention with invariant and overcomplete representation

Computational models: Bottom-up and top-down aspects

Modeling Bottom-Up Visual Attention for Color Images.

Feedback Selective Visual Attention Model Based on Feature Integration Theory.

A Visual Attention Based Object Detection Model beyond Top-Down and Bottom-up Mechanism

Visual Attention Model Based on Statistical Properties of Neuron Responses.

Classification Model of Visual Attention Based on Eye Movement Data

What Can Computational Models Learn From Human Selective Attention? A Review From an Audiovisual Unimodal and Crossmodal Perspective

A Survey of Visual Attention and Saliency Computation

Computational modelling of visual attention

A Review of Visual and Auditory Attention Computational Models

A Study of Top-Down Visual Attention Model Based on Similarity Distance

Image Visual Attention Computation and Application Via the Learning of Object Attributes

Visual Attention Model Based on Fussion of Spatiotemporal Features