Abstract:Key Points We review recent work on computational models of focal visual attention, with emphasis on the bottom-up, saliency- or image-based control of attentional deployment. We highlight five important trends that have emerged from the computational literature: First, the perceptual saliency of stimuli critically depends on surrounding context; that is, the same object may or may not appear salient depending on the nature and arrangement of other objects in the scene. Computationally, this means that contextual influences, such as non-classical surround interactions, must be included in models. Second, a unique 'saliency map' topographically encoding for stimulus conspicuity over the visual scene has proved to be an efficient and plausible bottom-up control strategy. Many successful models are based on such architecture, and electrophysiological as well as psychophysical studies have recently supported the idea that saliency is explicitly encoded in the brain. Third, inhibition-of-return (IOR), the process by which the currently attended location is transiently inhibited, is a critical element of attentional deployment. Without IOR, attention would endlessly be attracted towards the most salient stimulus. IOR thus implements a memory of recently visited locations, and allows attention to thoroughly scan our visual environment. Fourth, attention and eye movements tightly interplay, posing computational challenges with respect to the coordinate system used to control attention. Understanding the interaction between overt and covert attention is particularly important for models concerned with visual search. Last, scene understanding and object recognition strongly constrain the selection of attended locations. Although several models have approached, in an information-theoretical sense, the problem of optimally deploying attention to analyse a scene, biologically plausible implementations of such a computational strategy remain to be developed.

Trends, Applications, and Challenges in Human Attention Modelling

Attention, please! A survey of neural attention models in deep learning

Neural Attention Models in Deep Learning: Survey and Taxonomy

Attention mechanisms in computer vision: A survey

Visual Attention driven by Convolutional Features

Understanding More about Human and Machine Attention in Deep Neural Networks

Attention in Natural Language Processing

An Attentive Survey of Attention Models

Human Vs Machine Attention in Neural Networks: A Comparative Study.

A General Survey on Attention Mechanisms in Deep Learning

Recent advancements in driver's attention prediction

Visual Attention Methods in Deep Learning: An In-Depth Survey

Attention in Psychology, Neuroscience, and Machine Learning

Attention mechanism in neural networks: where it comes and where it goes

Interpreting Attention Models with Human Visual Attention in Machine Reading Comprehension

Selective Visual Attention: Computational Models and Applications

Human Attention Assessment Using A Machine Learning Approach with GAN-based Data Augmentation Technique Trained Using a Custom Dataset

Computational modelling of visual attention

From Cognition to Computation: A Comparative Review of Human Attention and Transformer Architectures

What Can Computational Models Learn From Human Selective Attention? A Review From an Audiovisual Unimodal and Crossmodal Perspective