Abstract:Bottom-up and top-down, as well as low-level and high-level factors influence where we fixate when viewing natural scenes. However, the importance of each of these factors and how they interact remains a matter of debate. Here, we disentangle these factors by analysing their influence over time. For this purpose we develop a saliency model which is based on the internal representation of a recent early spatial vision model to measure the low-level bottom-up factor. To measure the influence of high-level bottom-up features, we use a recent DNN-based saliency model. To account for top-down influences, we evaluate the models on two large datasets with different tasks: first, a memorisation task and, second, a search task. Our results lend support to a separation of visual scene exploration into three phases: The first saccade, an initial guided exploration characterised by a gradual broadening of the fixation density, and an steady state which is reached after roughly 10 fixations. Saccade target selection during the initial exploration and in the steady state are related to similar areas of interest, which are better predicted when including high-level features. In the search dataset, fixation locations are determined predominantly by top-down processes. In contrast, the first fixation follows a different fixation density and contains a strong central fixation bias. Nonetheless, first fixations are guided strongly by image properties and as early as 200 ms after image onset, fixations are better predicted by high-level information. We conclude that any low-level bottom-up factors are mainly limited to the generation of the first saccade. All saccades are better explained when high-level features are considered, and later this high-level bottom-up control can be overruled by top-down influences.

Look Twice: A Generalist Computational Model Predicts Return Fixations across Tasks and Species

A Hierarchical Model of Visual Processing Simulates Neural Mechanisms Underlying Reflexive Attention.

Predicting Visual Fixations

Beyond Fixation: detailed characterization of neural selectivity in free-viewing primates

Refixation behavior in naturalistic viewing: Methods, mechanisms, and neural correlates

A normalization model of visual search predicts single trial human fixations in an object search task

Fixation prediction with a combined model of bottom-up saliency and vanishing point

Feature-selective responses in macaque visual cortex follow eye movements during natural vision

Disentangling top-down vs. bottom-up and low-level vs. high-level influences on eye movements over time

Simulating human saccadic scanpaths on natural images

Modeling Bottom-Up and Top-Down Attention with a Neurodynamic Model of V1

Fixational Eye Movements Enhance the Precision of Visual Information Transmitted by the Primate Retina

Aftereffects of Saccades Explored in a Dynamic Neural Field Model of the Superior Colliculus

Express saccades and visual attention

Active inhibition and memory promote exploration and search of natural scenes

Beyond stimulus onset: Ongoing fixations within an object do not re-evoke category representations during free-viewing.

Predicting eye fixations with higher-level visual features.

Human visual search follows a suboptimal Bayesian strategy revealed by a spatiotemporal computational model and experiment

Modeling of Human Saccadic Scanpaths Based on Visual Saliency.

Visual Saliency As Sequential Eye Fixation Probability

Prospective and retrospective representations of saccadic movements in primate prefrontal cortex