Abstract:Visual attention is one of the most significant characteristics for selecting and understanding the outside redundancy world. The human vision system cannot process all information simultaneously due to the visual information bottleneck. In order to reduce the redundant input of visual information, the human visual system mainly focuses on dominant parts of scenes. This is commonly known as visual saliency map prediction. This paper proposed a new psychophysical saliency prediction architecture, WECSF, inspired by multi-channel model of visual cortex functioning in humans. The model consists of opponent color channels, wavelet transform, wavelet energy map, and contrast sensitivity function for extracting low-level image features and providing a maximum approximation to the human visual system. The proposed model is evaluated using several datasets, including the MIT1003, MIT300, TORONTO, SID4VAM, and UCF Sports datasets. We also quantitatively and qualitatively compare the saliency prediction performance with that of other state-of-the-art models. Our model achieved strongly stable and better performance with different metrics on natural images, psychophysical synthetic images and dynamic videos. Additionally, we found that Fourier and spectral-inspired saliency prediction models outperformed other state-of-the-art non-neural network and even deep neural network models on psychophysical synthetic images. It can be explained and supported by the Fourier Vision Hypothesis. In the meantime, we suggest that deep neural networks need specific architectures and goals to be able to predict salient performance on psychophysical synthetic images better and more reliably. Finally, the proposed model could be used as a computational model of primate vision system and help us understand mechanism of primate vision system.

A Computational Pixelization Model Based on Selective Attention for Artificial Visual Prosthesis

A Computational Imaging Model and Experimental Assessment for Artificial Visual Prosthesis

Facial Recognition Using Enhanced Pixelized Image for Simulated Visual Prosthesis

Pixelized Images Recognition in Simulated Prosthetic Vision

Clinical Progress and Optimization of Information Processing in Artificial Visual Prostheses

Visual Fixation-Based Retinal Prosthetic Simulation

[Research on and Design of Visual Prosthesis Based on Visual Information Processing].

The application of computer vision to visual prosthesis

Image processing based recognition of images with a limited number of pixels using simulated prosthetic vision

Simulation of Mono-eye Blind Spot Effect Based on Visual System

A Visual Attention Model for Adapting Images on Small Displays

A Psychophysically Oriented Saliency Map Prediction Model

Study of tactile perception based on phosphene positioning using simulated prosthetic vision.

A Computational Retina Model and Its Self-Adjustment Property

Human-in-the-Loop Optimization for Deep Stimulus Encoding in Visual Prostheses

Image Visual Attention Computation and Application Via the Learning of Object Attributes

Predicting the Temporal Dynamics of Prosthetic Vision

Improved VGG Algorithm for Visual Prosthesis Image Recognition

Recognition of pixelized Chinese characters using simulated prosthetic vision.

Selective Visual Attention: Computational Models and Applications

A Computational Model for Stereoscopic Visual Saliency Prediction