Abstract:Key Points We review recent work on computational models of focal visual attention, with emphasis on the bottom-up, saliency- or image-based control of attentional deployment. We highlight five important trends that have emerged from the computational literature: First, the perceptual saliency of stimuli critically depends on surrounding context; that is, the same object may or may not appear salient depending on the nature and arrangement of other objects in the scene. Computationally, this means that contextual influences, such as non-classical surround interactions, must be included in models. Second, a unique 'saliency map' topographically encoding for stimulus conspicuity over the visual scene has proved to be an efficient and plausible bottom-up control strategy. Many successful models are based on such architecture, and electrophysiological as well as psychophysical studies have recently supported the idea that saliency is explicitly encoded in the brain. Third, inhibition-of-return (IOR), the process by which the currently attended location is transiently inhibited, is a critical element of attentional deployment. Without IOR, attention would endlessly be attracted towards the most salient stimulus. IOR thus implements a memory of recently visited locations, and allows attention to thoroughly scan our visual environment. Fourth, attention and eye movements tightly interplay, posing computational challenges with respect to the coordinate system used to control attention. Understanding the interaction between overt and covert attention is particularly important for models concerned with visual search. Last, scene understanding and object recognition strongly constrain the selection of attended locations. Although several models have approached, in an information-theoretical sense, the problem of optimally deploying attention to analyse a scene, biologically plausible implementations of such a computational strategy remain to be developed.

An Attentive Survey of Attention Models

Neural Attention Models in Deep Learning: Survey and Taxonomy

Attention, please! A survey of neural attention models in deep learning

Attention Models in Graphs: A Survey

A General Survey on Attention Mechanisms in Deep Learning

Understanding Attention: In Minds and Machines

Attention-based graph neural networks: a survey

Attention in Natural Language Processing

Trends, Applications, and Challenges in Human Attention Modelling

Visual Attention Methods in Deep Learning: An In-Depth Survey

Computational models: Bottom-up and top-down aspects

Attention Mechanisms in Computer Vision: A Survey

Understanding More about Human and Machine Attention in Deep Neural Networks

Attention in Psychology, Neuroscience, and Machine Learning

Attention mechanism in neural networks: where it comes and where it goes

Computational models of attention

Computational modelling of visual attention

An Overview of the Attention Mechanisms in Computer Vision

Human Vs Machine Attention in Neural Networks: A Comparative Study.

Selective Attention and Consciousness: Investigating Their Relation Through Computational Modelling