Abstract:Visual attention aims at selecting a salient subset from the visual input for further processing while ignoring redundant data. The dominant view for the computation of visual attention is based on the assumption that bottom-up visual saliency such as local contrast and interest points drives the allocation of attention in scene viewing. However, we advocate in this paper that the deployment of attention is primarily and directly guided by objects and thus propose a novel framework to explore image visual attention via the learning of object attributes from eye-tracking data. We mainly aim to solve three problems: (1) the pixel-level visual attention computation (the saliency map); (2) the image-level visual attention computation; (3) the application of the computation model in image categorization. We first adopt the algorithm of object bank to acquire the responses to a number of object detectors at each location in an image and thus form a feature descriptor to indicate the occurrences of various objects at a pixel or in an image. Next, we integrate the inference of interesting objects from fixations in eye-tracking data with the competition among surrounding objects to solve the first problem. We further propose a computational model to solve the second problem and estimate the interestingness of each image via the mapping between object attributes and the inter-observer visual congruency obtained from eye-tracking data. Finally, we apply the proposed pixel-level visual attention model to the image categorization task. Comprehensive evaluations on publicly available benchmarks and comparisons with state-of-the-art methods demonstrate the effectiveness of the proposed models.

A Visual Attention Model for Adapting Images on Small Displays

Image Adaptation Based on Attention Model for Small-Form-Factor Device

A visual attention model for adapting images on small displays

Visual Attention Based Image Browsing on Mobile Devices

Visual Attention Modeling Based on Short-Term Environmental Adaption

Adaptive Image Retargeting Using Saliency-Based Continuous Seam Carving

Acquisition of Vision Adaptability Image

An Attention-Information-Based Spatial Adaptation Framework for Browsing Videos Via Mobile Devices

Adapting Images On Proxies For Small Form Factor Devices

Region-based visual attention analysis with its application in image browsing on small displays.

Event-Based Semantic Image Adaptation for User-Centric Mobile Display Devices

Automatic Browsing of Large Pictures on Mobile Devices.

Image Compression for Machine and Human Vision with Spatial-Frequency Adaptation

Chapter 17 MULTIMEDIA ADAPTATION AND BROWSING ON SMALL DISPLAYS

Browsing Large Pictures under Limited Display Sizes.

Learning User Interest for Image Browsing on Small-Form-factor Devices

User guided semantic image adaptation for mobile display devices

A Visual Attention Model Based On The Compressed Domain

Image Visual Attention Computation and Application Via the Learning of Object Attributes

An Adaptive Multi-Sensor Visual Attention Model

Visual Attention Data for Image Quality Assessment Databases