Abstract:Key Points We review recent work on computational models of focal visual attention, with emphasis on the bottom-up, saliency- or image-based control of attentional deployment. We highlight five important trends that have emerged from the computational literature: First, the perceptual saliency of stimuli critically depends on surrounding context; that is, the same object may or may not appear salient depending on the nature and arrangement of other objects in the scene. Computationally, this means that contextual influences, such as non-classical surround interactions, must be included in models. Second, a unique 'saliency map' topographically encoding for stimulus conspicuity over the visual scene has proved to be an efficient and plausible bottom-up control strategy. Many successful models are based on such architecture, and electrophysiological as well as psychophysical studies have recently supported the idea that saliency is explicitly encoded in the brain. Third, inhibition-of-return (IOR), the process by which the currently attended location is transiently inhibited, is a critical element of attentional deployment. Without IOR, attention would endlessly be attracted towards the most salient stimulus. IOR thus implements a memory of recently visited locations, and allows attention to thoroughly scan our visual environment. Fourth, attention and eye movements tightly interplay, posing computational challenges with respect to the coordinate system used to control attention. Understanding the interaction between overt and covert attention is particularly important for models concerned with visual search. Last, scene understanding and object recognition strongly constrain the selection of attended locations. Although several models have approached, in an information-theoretical sense, the problem of optimally deploying attention to analyse a scene, biologically plausible implementations of such a computational strategy remain to be developed.

A model of saliency-based visual attention for rapid scene analysis

An event-based implementation of saliency-based visual attention for rapid scene analysis

Computational modelling of visual attention

A novel hierarchical model of attention: maximizing information acquisition

Spatial statistics and attentional dynamics in scene viewing

A biologically inspired computational model for image saliency detection.

Visual Saliency Detection Based on Topographic Independent Component Analysis

What Do Deep Saliency Models Learn about Visual Attention?

Modeling Bottom-Up and Top-Down Attention with a Neurodynamic Model of V1

A Survey of Visual Attention and Saliency Computation

A Hierarchical Model of Visual Processing Simulates Neural Mechanisms Underlying Reflexive Attention.

Saliency map using features derived from spiking neural networks of primate visual cortex

A VISUAL ATTENTION MODEL FOR NATURAL SCENES BASED ON DYNAMIC FEATURE COMBINATION

A Psychophysically Oriented Saliency Map Prediction Model

A Biological Inspired Features Based Saliency Map

A Deep Model of Visual Attention for Saliency Detection on 3D Objects

Deep saliency models learn low-, mid-, and high-level features to predict scene attention

Hebbian-Based Neural Networks for Bottom-Up Visual Attention Systems

A Neurodynamical Theory Of Visual Attention: Comparisons With Fmri- And Single-Neuron Data

Visual Attention is Beyond One Single Saliency Map

Visual Attention Modeling Based on Short-Term Environmental Adaption