Abstract:Visual attention aims at selecting a salient subset from the visual input for further processing while ignoring redundant data. The dominant view for the computation of visual attention is based on the assumption that bottom-up visual saliency such as local contrast and interest points drives the allocation of attention in scene viewing. However, we advocate in this paper that the deployment of attention is primarily and directly guided by objects and thus propose a novel framework to explore image visual attention via the learning of object attributes from eye-tracking data. We mainly aim to solve three problems: (1) the pixel-level visual attention computation (the saliency map); (2) the image-level visual attention computation; (3) the application of the computation model in image categorization. We first adopt the algorithm of object bank to acquire the responses to a number of object detectors at each location in an image and thus form a feature descriptor to indicate the occurrences of various objects at a pixel or in an image. Next, we integrate the inference of interesting objects from fixations in eye-tracking data with the competition among surrounding objects to solve the first problem. We further propose a computational model to solve the second problem and estimate the interestingness of each image via the mapping between object attributes and the inter-observer visual congruency obtained from eye-tracking data. Finally, we apply the proposed pixel-level visual attention model to the image categorization task. Comprehensive evaluations on publicly available benchmarks and comparisons with state-of-the-art methods demonstrate the effectiveness of the proposed models.

Guest Editorial Special Section on Visual Saliency Computing and Learning.

Learning Stereoscopic Visual Attention Model for 3d Video

Detect saliency to understand a photo

Guest Editorial Introduction to the Special Section on Intelligent Visual Content Analysis and Understanding

Modern Learning Methodologies for Co-Saliency Detection

An Object-Oriented Visual Saliency Detection Framework Based on Sparse Coding Representations

Image Visual Attention Computation and Application Via the Learning of Object Attributes

A Study on Visual Perception of Light Field Content

Review of Visual Saliency Detection with Comprehensive Information

A Study on Interest Point Guided Visual Saliency.

GreenSaliency: A Lightweight and Efficient Image Saliency Detection Method

IEEE Access Special Section Editorial: Biologically Inspired Image Processing Challenges and Future Directions

A biologically inspired computational model for image saliency detection.

Guest Editorial Introduction to the Special Section on Video and Language

Guest Editorial Introduction to the Special Section on Representation Learning for Visual Content Understanding

Finding the Secret of Image Saliency in the Frequency Domain

Guest Editorial: Visual Analytics in Multimedia—Opportunities and Research Challenges

Visual saliency detection based on photographic composition

Learning to Detect A Salient Object

Learning to Model Task-Oriented Attention

GazeFusion: Saliency-guided Image Generation