Abstract:Key Points We review recent work on computational models of focal visual attention, with emphasis on the bottom-up, saliency- or image-based control of attentional deployment. We highlight five important trends that have emerged from the computational literature: First, the perceptual saliency of stimuli critically depends on surrounding context; that is, the same object may or may not appear salient depending on the nature and arrangement of other objects in the scene. Computationally, this means that contextual influences, such as non-classical surround interactions, must be included in models. Second, a unique 'saliency map' topographically encoding for stimulus conspicuity over the visual scene has proved to be an efficient and plausible bottom-up control strategy. Many successful models are based on such architecture, and electrophysiological as well as psychophysical studies have recently supported the idea that saliency is explicitly encoded in the brain. Third, inhibition-of-return (IOR), the process by which the currently attended location is transiently inhibited, is a critical element of attentional deployment. Without IOR, attention would endlessly be attracted towards the most salient stimulus. IOR thus implements a memory of recently visited locations, and allows attention to thoroughly scan our visual environment. Fourth, attention and eye movements tightly interplay, posing computational challenges with respect to the coordinate system used to control attention. Understanding the interaction between overt and covert attention is particularly important for models concerned with visual search. Last, scene understanding and object recognition strongly constrain the selection of attended locations. Although several models have approached, in an information-theoretical sense, the problem of optimally deploying attention to analyse a scene, biologically plausible implementations of such a computational strategy remain to be developed.

Eye-Tracking Study Using Cellular Automaton Patterns as Visual Stimuli: Implications for Current Models of Stimulus-Driven Selection Processes

Investigating Cultural Diversity for Extrafoveal Information Use in Visual Scenes.

Evaluating Atypical Gaze Patterns through Vision Models: The Case of Cortical Visual Impairment

Oculomotor behavior and perceptual strategies in complex tasks

Computational modelling of visual attention

Predicting Visual Fixations

What Are We Looking For: Towards Statistical Modeling of Saccadic Eye Movements and Visual Saliency

Toward Statistical Modeling of Saccadic Eye-Movement and Visual Saliency.

The nature of the visual representations involved in eye movements when walking down the street

Disentangling top-down vs. bottom-up and low-level vs. high-level influences on eye movements over time

Consequences of eye movements for spatial selectivity

Spatial statistics and attentional dynamics in scene viewing

Look Twice: A Generalist Computational Model Predicts Return Fixations across Tasks and Species

Low-level and high-level modulations of fixational saccades and high frequency oscillatory brain activity in a visual object classification task

Learning to Model Task-Oriented Attention

Attentional Modulation of Visual Spatial Integration: Psychophysical Evidence Supported by Population Coding Modeling

Common structure of saccades and microsaccades in visual perception.

Strategies for enhancing automatic fixation detection in head-mounted eye tracking

Salient Locations Search Based on Human Visual Attention: an Experimental Analysis

Visual Attention is Beyond One Single Saliency Map

A computational account of transsaccadic attentional allocation based on visual gain fields