Abstract:Visual attention aims at selecting a salient subset from the visual input for further processing while ignoring redundant data. The dominant view for the computation of visual attention is based on the assumption that bottom-up visual saliency such as local contrast and interest points drives the allocation of attention in scene viewing. However, we advocate in this paper that the deployment of attention is primarily and directly guided by objects and thus propose a novel framework to explore image visual attention via the learning of object attributes from eye-tracking data. We mainly aim to solve three problems: (1) the pixel-level visual attention computation (the saliency map); (2) the image-level visual attention computation; (3) the application of the computation model in image categorization. We first adopt the algorithm of object bank to acquire the responses to a number of object detectors at each location in an image and thus form a feature descriptor to indicate the occurrences of various objects at a pixel or in an image. Next, we integrate the inference of interesting objects from fixations in eye-tracking data with the competition among surrounding objects to solve the first problem. We further propose a computational model to solve the second problem and estimate the interestingness of each image via the mapping between object attributes and the inter-observer visual congruency obtained from eye-tracking data. Finally, we apply the proposed pixel-level visual attention model to the image categorization task. Comprehensive evaluations on publicly available benchmarks and comparisons with state-of-the-art methods demonstrate the effectiveness of the proposed models.

Visual Attention Based Image Classification

Efficient Classification Using Salient Regions

Visual Attention in Multi-Label Image Classification.

Image Visual Attention Computation and Application Via the Learning of Object Attributes

Classification Model of Visual Attention Based on Eye Movement Data

A visual attention model combining top-down and bottom-up mechanisms for salient object detection

Modeling Bottom-Up Visual Attention for Color Images.

A Model for Image Categorisation Based on a Biological Visual Mechanism

An Approach to Improving Image Classification Using Visual Attention Weight Order

Visual Attention Model Based on Statistical Properties of Neuron Responses.

A VISUAL ATTENTION MODEL FOR NATURAL SCENES BASED ON DYNAMIC FEATURE COMBINATION

Visual Attention Model with a Novel Learning Strategy and Its Application to Target Detection from SAR Images.

A Visual Attention Based Object Detection Model beyond Top-Down and Bottom-up Mechanism

Attention Graph: Learning Effective Visual Features for Large-Scale Image Classification

A Computational Model of Selecting Visual Attention Based on Bottom-Up and Top-Down Feature Combination

Attend and Imagine: Multi-Label Image Classification with Visual Attention and Recurrent Neural Networks

Visual Attention Inspired Distant View and Close-Up View Classification.

Visual Attention Based Bag-of-words Model for Image Classification

A Modified Selective Attention Model for Salient Region Detection in Real Scenes.

Visual Attention-Driven Hyperspectral Image Classification

Remote Sensing Target Detection Based on Visual Saliency Guidance and Classifier Fusion