Abstract:Background: An important problem in selective attention is determining the ways the primary visual cortex contributes to the encoding of bottom-up saliency and the types of neural computation that are effective to model this process. To address this problem, we constructed a two-layered network that satisfies the neurobiological constraints of the primary visual cortex to detect salient objects. We carried out experiments on both synthetic images and natural images to explore the influences of different factors, such as network structure, the size of each layer, the type of suppression and the combination strategy, on saliency detection performance. Results: The experimental results statistically demonstrated that the type and scale of filters contribute greatly to the encoding of bottom-up saliency. These two factors correspond to the mechanisms of invariant encoding and overcomplete representation in the primary visual cortex. Conclusions: (1) Instead of constructing Gabor functions or Gaussian pyramids filters for feature extraction as traditional attention models do, we learn overcomplete basis sets from natural images to extract features for saliency detection. Experiments show that given the proper layer size and a robust combination strategy, the learned overcomplete basis set outperforms a complete set and Gabor pyramids in visual saliency detection. This finding can potentially be applied in task-dependent and supervised object detection. (2) A hierarchical coding model that can represent invariant features, is designed for the pre-attentive stage of bottom-up attention. This coding model improves robustness to noises and distractions and improves the ability of detecting salient structures, such as collinear and co-circular structures, and several composite stimuli. This result indicates that invariant representation contributes to saliency detection (popping out) in bottom-up attention. The aforementioned perspectives will significantly contribute to the in-depth understanding of the information processing mechanism in the primary visual system.

A Selective Sparse Coding Model with Embedded Attention Mechanism

A Model of Attention-Guided Visual Sparse Coding

Sparse Embedding Visual Attention Model

Online Discriminative Sparse Coding As a Systems-level Model of the Primate's Dorsal and Ventral Pathways

Sparse Embedding Visual Attention System Combined with Edge Information

Sparse embedding feature combination strategy for saliency-based visual attention system

Adaptive compressed sensing - a new class of self-organizing coding models for neuroscience

A Computational Coding Model for Saliency Detection in Primary Visual Cortex

An Associative Sparse Coding Neural Network And Applications

Time varying images sparse coding network model based on simple cell in visual cortex

Sparse Embedding Visual Attention Systems Combined with Edge Information

New Evidences for Sparse Coding Strategy Employed in Visual Neurons: from the Image Processing and Nonlinear Approximation Viewpoint.

Hierarchical Spiking-Based Model for Efficient Image Classification with Enhanced Feature Extraction and Encoding.

Visual Attention Model Based on Statistical Properties of Neuron Responses.

A neural computational model for bottom-up attention with invariant and overcomplete representation

Task-Oriented Sparse Coding Model for Pattern Classification

Efficient Visual Coding: From Retina To V2

A Single Model Explains both Visual and Auditory Precortical Coding

A Spatial–Channel–Temporal-Fused Attention for Spiking Neural Networks

Saliency Based on Cortex-Like Mechanisms.

A Two-Layer Feedback Vision Sparse Coding Model Based On Multilayer Perceptrons