Abstract:Saliency map and object map are the two contrasting hypotheses for the mechanisms utilized by the visual system to guide eye fixations when humans are freely viewing natural images. Most computational studies define saliency as outliers of distributions of low-level features, and propose saliency as an important factor for predicting eye fixations. Psychophysical studies, however, suggest that high-level objects predict eye fixations more accurately and the early saliency only has a minor effect. But this view has been challenged by a study which shows opposite results, suggesting that the role of object-level features needs further investigations. In addition, little is known about the role of intermediate features between the low-level and the object-level features. In this paper, we construct two models based on mid-level and object-level features, respectively, and compare their performances against those based on low-level features. Quantitative evaluation on three benchmark natural image fixation data sets demonstrates that the mid-level model outperforms the state-of-the-art low-level models by a significant margin and the object-level model is inferior to most low-level models. Quantitative evaluation on a video fixation data set demonstrates that both the mid-level and object-level models outperform the state-of-the-art low-level models, and the latter performs better under three out of four standard metrics. When combined together the two proposed models achieve even higher performance. However, incorporating the best low-level model yields negligible improvements on all of the data sets. Taken together, these results indicate that higher level features may be more effective than low-level features for predicting eye fixations on natural images in the free viewing condition.

Predicting human gaze beyond pixels.

Spatial-Aware Object-Level Saliency Prediction by Learning Graphlet Hierarchies

Towards Pixel-Level Prediction for Gaze Following: Benchmark and Approach

Object Detection Based on Saturation of Visual Perception

Digging Deeper into Egocentric Gaze Prediction

Improving saliency models' predictions of the next fixation with humans' intrinsic cost of gaze shifts

A structure-guided approach to the prediction of natural image saliency

What Do Deep Saliency Models Learn about Visual Attention?

Learning to Model Task-Oriented Attention

Weakly Supervised Human Fixations Prediction

Deep Visual Attention Prediction

Predicting eye fixations with higher-level visual features.

Spatial and Temporal Visual Attention Prediction in Videos Using Eye Movement Data

A biologically inspired computational model for image saliency detection.

Model-aware 3D Eye Gaze from Weak and Few-shot Supervisions

A Computational Model for Stereoscopic Visual Saliency Prediction

Saliency Prediction with Scene Structural Guidance

Gazeformer: Scalable, Effective and Fast Prediction of Goal-Directed Human Attention

A Survey of Visual Attention and Saliency Computation

Image Visual Attention Computation and Application Via the Learning of Object Attributes

Predicting Visual Fixations