Abstract:Human visual system can selectively attend to parts of a scene for quick perception, a biological mechanism known as Human attention. Inspired by this, recent deep learning models encode attention mechanisms to focus on the most task-relevant parts of the input signal for further processing, which is called Machine/Neural/Artificial attention. Understanding the relation between human and machine attention is important for interpreting and designing neural networks. Many works claim that the attention mechanism offers an extra dimension of interpretability by explaining where the neural networks look. However, recent studies demonstrate that artificial attention maps do not always coincide with common intuition. In view of these conflicting evidence, here we make a systematic study on using artificial attention and human attention in neural network design. With three example computer vision tasks, diverse representative backbones, and famous architectures, corresponding real human gaze data, and systematically conducted large-scale quantitative studies, we quantify the consistency between artificial attention and human visual attention and offer novel insights into existing artificial attention mechanisms by giving preliminary answers to several key questions related to human and artificial attention mechanisms. Overall results demonstrate that human attention can benchmark the meaningful `ground-truth' in attention-driven tasks, where the more the artificial attention is close to human attention, the better the performance; for higher-level vision tasks, it is case-by-case. It would be advisable for attention-driven tasks to explicitly force a better alignment between artificial and human attention to boost the performance; such alignment would also improve the network explainability for higher-level computer vision tasks.

Attention Mechanisms and Their Applications to Complex Systems

Attention mechanism in neural networks: where it comes and where it goes

Attention in Psychology, Neuroscience, and Machine Learning

A review on the attention mechanism of deep learning

Attention, please! A survey of neural attention models in deep learning

An Overview of the Attention Mechanisms in Computer Vision

Attention Mechanisms in Computer Vision: A Survey

A General Survey on Attention Mechanisms in Deep Learning

Neural Attention Models in Deep Learning: Survey and Taxonomy

A conceptual frame with two neural mechanisms to model selective visual attention processes

Attention: Marginal Probability is All You Need?

Long Short-Term Attention

Understanding Attention: In Minds and Machines

Trends, Applications, and Challenges in Human Attention Modelling

A Generalized Attention Mechanism to Enhance the Accuracy Performance of Neural Networks

Selective Visual Attention: Computational Models and Applications

Attention in Natural Language Processing

Understanding More about Human and Machine Attention in Deep Neural Networks

How biological attention mechanisms improve task performance in a large-scale visual system model

Modeling Attention and Binding in the Brain through Bidirectional Recurrent Gating