Abstract:Background: An important problem in selective attention is determining the ways the primary visual cortex contributes to the encoding of bottom-up saliency and the types of neural computation that are effective to model this process. To address this problem, we constructed a two-layered network that satisfies the neurobiological constraints of the primary visual cortex to detect salient objects. We carried out experiments on both synthetic images and natural images to explore the influences of different factors, such as network structure, the size of each layer, the type of suppression and the combination strategy, on saliency detection performance. Results: The experimental results statistically demonstrated that the type and scale of filters contribute greatly to the encoding of bottom-up saliency. These two factors correspond to the mechanisms of invariant encoding and overcomplete representation in the primary visual cortex. Conclusions: (1) Instead of constructing Gabor functions or Gaussian pyramids filters for feature extraction as traditional attention models do, we learn overcomplete basis sets from natural images to extract features for saliency detection. Experiments show that given the proper layer size and a robust combination strategy, the learned overcomplete basis set outperforms a complete set and Gabor pyramids in visual saliency detection. This finding can potentially be applied in task-dependent and supervised object detection. (2) A hierarchical coding model that can represent invariant features, is designed for the pre-attentive stage of bottom-up attention. This coding model improves robustness to noises and distractions and improves the ability of detecting salient structures, such as collinear and co-circular structures, and several composite stimuli. This result indicates that invariant representation contributes to saliency detection (popping out) in bottom-up attention. The aforementioned perspectives will significantly contribute to the in-depth understanding of the information processing mechanism in the primary visual system.

Computational Model of Primary Visual Cortex Combining Visual Attention for Action Recognition

Human Action Recognition by Imitating the Simple Cells of Visual Cortex

Biologically Inspired Visual Model With Preliminary Cognition and Active Attention Adjustment

Visual Attention Model Based on Visual Cortex Mechanisms

An Attentional Spatial Temporal Graph Convolutional Network with Co-Occurrence Feature Learning for Action Recognition

Model of Human Visual Cortex Inspired Computational Models for Visual Recognition

B2C-AFM: Bi-Directional Co-Temporal and Cross-Spatial Attention Fusion Model for Human Action Recognition.

Action Recognition Using Visual Attention with Reinforcement Learning.

Computational Model for Perception of Objects and Motions.

Integrating Temporal and Spatial Attention for Video Action Recognition

Visual Scene Induced Three-stream Network for Efficient Action Recognition

Recurrent Attention Network Using Spatial-Temporal Relations for Action Recognition

Interaction-Aware Spatio-Temporal Pyramid Attention Networks for Action Classification

A neural computational model for bottom-up attention with invariant and overcomplete representation

A Computational Model of Early Vision Based on Synchronized Response and Inner Product Operation.

Modelling Human Visual Motion Processing with Trainable Motion Energy Sensing and a Self-attention Network

Select and Focus: Action Recognition with Spatial-Temporal Attention

Self-organizing neural integration of pose-motion features for human action recognition

Interpretable Spatio-temporal Attention for Video Action Recognition

Neural interactions in occipitotemporal cortex during basic human movement perception by dynamic causal modeling

Human Attention Model for Action Movie Analysis