Abstract:Most studies in computational modeling of visual attention encompass task-free observation of images. Free-viewing saliency considers limited scenarios of daily life. Most visual activities are goal-oriented and demand a great amount of top-down attention control. Visual search task demands more top-down control of attention, compared to free-viewing. In this paper, we present two approaches to model visual attention and distraction of observers during visual search. Our first approach adapts a light-weight free-viewing saliency model to predict eye fixation density maps of human observers over pixels of search images, using a two-stream convolutional encoder-decoder network, trained and evaluated on COCO-Search18 dataset. This method predicts which locations are more distracting when searching for a particular target. Our network achieves good results on standard saliency metrics (AUC-Judd=0.95, AUC-Borji=0.85, sAUC=0.84, NSS=4.64, KLD=0.93, CC=0.72, SIM=0.54, and IG=2.59). Our second approach is object-based and predicts the distractor and target objects during visual search. Distractors are all objects except the target that observers fixate on during search. This method uses a Mask-RCNN segmentation network pre-trained on MS-COCO and fine-tuned on COCO-Search18 dataset. We release our segmentation annotations of targets and distractors in COCO-Search18 for three target categories: bottle, bowl, and car. The average scores over the three categories are: F1-score=0.64, MAP(iou:0.5)=0.57, MAR(iou:0.5)=0.73. Our implementation code in Tensorflow is publicly available at <a class="link-external link-https" href="https://github.com/ManooshSamiei/Distraction-Visual-Search" rel="external noopener nofollow">this https URL</a> .

Vanishing point detection with convolutional neural networks

Virtual View Generation Based on 3D-Dense-attentive GAN Networks

Visual relationship detection with a deep convolutional relationship network

NeurVPS: Neural Vanishing Point Scanning Via Conic Convolution.

Visual Localizer: Outdoor Localization Based on ConvNet Descriptor and Global Optimization for Visually Impaired Pedestrians

Deep Learning for Vanishing Point Detection Using an Inverse Gnomonic Projection

Vanishing Point Estimation for Challenging Road Images.

D-VPnet: A Network for Real-time Dominant Vanishing Point Detection in Natural Scenes

A New Efficient Vanishing Point Detection From A Single Image

Three Orthogonal Vanishing Points Estimation In Structured Scenes Using Convolutional Neural Networks

Research on the Vanishing Point Detection Method Based on an Improved Lightweight AlexNet Network for Narrow Waterway Scenarios

RVPNet: A real time unstructured road vanishing point detection algorithm using attention mechanism and global context information

Vanishing Point Detection with Direct and Transposed Fast Hough Transform inside the neural network

Predicting Visual Attention and Distraction During Visual Search Using Convolutional Neural Networks

New Efficient Vanishing Point Detection from A Single Road Image Based on Intrinsic Line Orientation and Color Texture Properties

Optimal Vanishing Point Estimation with Performance Evaluation

Video Salient Object Detection via Fully Convolutional Networks

Fast and Robust Vanishing Point Detection for Unstructured Road Following.

Detecting Dominant Vanishing Points in Natural Scenes with Application to Composition-Sensitive Image Retrieval

Enhancing Road Safety: Real-Time Detection of Driver Distraction through Convolutional Neural Networks

Real-time Road Detection with Image Texture Analysis-Based Vanishing Point Estimation