Abstract:Human visual system can selectively attend to parts of a scene for quick perception, a biological mechanism known as Human attention. Inspired by this, recent deep learning models encode attention mechanisms to focus on the most task-relevant parts of the input signal for further processing, which is called Machine/Neural/Artificial attention. Understanding the relation between human and machine attention is important for interpreting and designing neural networks. Many works claim that the attention mechanism offers an extra dimension of interpretability by explaining where the neural networks look. However, recent studies demonstrate that artificial attention maps do not always coincide with common intuition. In view of these conflicting evidence, here we make a systematic study on using artificial attention and human attention in neural network design. With three example computer vision tasks, diverse representative backbones, and famous architectures, corresponding real human gaze data, and systematically conducted large-scale quantitative studies, we quantify the consistency between artificial attention and human visual attention and offer novel insights into existing artificial attention mechanisms by giving preliminary answers to several key questions related to human and artificial attention mechanisms. Overall results demonstrate that human attention can benchmark the meaningful `ground-truth' in attention-driven tasks, where the more the artificial attention is close to human attention, the better the performance; for higher-level vision tasks, it is case-by-case. It would be advisable for attention-driven tasks to explicitly force a better alignment between artificial and human attention to boost the performance; such alignment would also improve the network explainability for higher-level computer vision tasks.

Attention Schema in Neural Agents

The attention schema theory in a neural network agent: Controlling visuospatial attention using a descriptive model of attention

Attention or memory? Neurointerpretable agents in space and time

Computational characterization of the role of an attention schema in controlling visuospatial attention

S2RL: Do We Really Need to Perceive All States in Deep Multi-Agent Reinforcement Learning?

S2rl

Joint Attention for Multi-Agent Coordination and Social Learning

The Attention Schema Theory: A Foundation for Engineering Artificial Consciousness

Attentional Policies for Cross-Context Multi-Agent Reinforcement Learning

Cascaded Attention: Adaptive and Gated Graph Attention Network for Multiagent Reinforcement Learning

Self-Attention for Deep Reinforcement Learning.

Attention control and the attention schema theory of consciousness

Neural Attention Models in Deep Learning: Survey and Taxonomy

Inverse Attention Agent for Multi-Agent System

Attention, please! A survey of neural attention models in deep learning

Hard Attention Control By Mutual Information Maximization

Human Vs Machine Attention in Neural Networks: A Comparative Study.

Learning to attend in a brain-inspired deep neural network

Understanding More about Human and Machine Attention in Deep Neural Networks

Complementary Attention for Multi-Agent Reinforcement Learning.

Towards Interpretable Reinforcement Learning Using Attention Augmented Agents