Abstract:Key Points We review recent work on computational models of focal visual attention, with emphasis on the bottom-up, saliency- or image-based control of attentional deployment. We highlight five important trends that have emerged from the computational literature: First, the perceptual saliency of stimuli critically depends on surrounding context; that is, the same object may or may not appear salient depending on the nature and arrangement of other objects in the scene. Computationally, this means that contextual influences, such as non-classical surround interactions, must be included in models. Second, a unique 'saliency map' topographically encoding for stimulus conspicuity over the visual scene has proved to be an efficient and plausible bottom-up control strategy. Many successful models are based on such architecture, and electrophysiological as well as psychophysical studies have recently supported the idea that saliency is explicitly encoded in the brain. Third, inhibition-of-return (IOR), the process by which the currently attended location is transiently inhibited, is a critical element of attentional deployment. Without IOR, attention would endlessly be attracted towards the most salient stimulus. IOR thus implements a memory of recently visited locations, and allows attention to thoroughly scan our visual environment. Fourth, attention and eye movements tightly interplay, posing computational challenges with respect to the coordinate system used to control attention. Understanding the interaction between overt and covert attention is particularly important for models concerned with visual search. Last, scene understanding and object recognition strongly constrain the selection of attended locations. Although several models have approached, in an information-theoretical sense, the problem of optimally deploying attention to analyse a scene, biologically plausible implementations of such a computational strategy remain to be developed.

A computational approach to the covert and overt deployment of spatial attention

A computational account of transsaccadic attentional allocation based on visual gain fields

A Hierarchical Model of Visual Processing Simulates Neural Mechanisms Underlying Reflexive Attention.

Computational modelling of visual attention

Different computations underlie overt presaccadic and covert spatial attention

Attentional Modulation of Visual Spatial Integration: Psychophysical Evidence Supported by Population Coding Modeling

Spatial statistics and attentional dynamics in scene viewing

Cortical regions involved in eye movements, shifts of attention, and gaze perception

Is covert attention necessary for programming accurate saccades? Evidence from saccade-locked event-related potentials

Express saccades and visual attention

A probabilistic tour of visual attention and gaze shift computational models

Common cortical areas have different neural mechanisms for covert and overt visual pursuits

Dynamic estimation of the attentional field from visual cortical activity

Top-Down Priors Disambiguate Target and Distractor Features in Simulated Covert Visual Search

Neuronal modulation in the mouse superior colliculus during covert visual selective attention

Coupling of saccade plans to endogenous attention during urgent choices

What Are We Looking For: Towards Statistical Modeling of Saccadic Eye Movements and Visual Saliency

Spatial Attention, Feature-Based Attention, and Saccades: Three Sides of One Coin?

Toward Statistical Modeling of Saccadic Eye-Movement and Visual Saliency.

Modeling Bottom-Up and Top-Down Attention with a Neurodynamic Model of V1

On the control of attentional processes in vision