Abstract:From the perspective of Computer vision, both visual saliency and object detection have attracted hot attention in the field of traffic scene perception. However, these two tasks are often seen as independent missions, and their correlations have rarely been explored. In real driving scenarios, drivers mainly care about the salient objects closely related to the current driving task under the guidance of visual selective attention. This process highly integrates saliency perception and object detection, leading to efficient and quick decision-making, thus achieving safe driving. In this study, with reference to human drivers’ perception of traffic scenes, we focus on detecting fixated objects within the regions attracting the drivers’ attention. Firstly, we build a new fixated object detection dataset based on drivers’ fixations, which can serve as a benchmark for studying traffic object detection from the driver’s point of view. Then, we propose a fixated object detection model based on saliency prior, named FOD-Net. FOD-Net takes advantage of the predicted salient regions as saliency priors to guide the detection of the fixated objects that are closely relevant to the driving task, thus improving detection accuracy. Experimental results on the proposed dataset show that FOD-Net achieves a mAP value of 78.4% with small model parameters, which is higher than other state-of-the-art models. Our work combines the driver’s attention mechanism with object detection to narrow the gap between visual saliency and object detection in traffic scenes, showing potential supplemental or referential value for developing high-intelligence assisted/automatic driving systems. The dataset and code are available in https://github.com/YiShi701/Fixated-object-detection.

Top-Down Based Saliency Model In Traffic Driving Environment

Where Does the Driver Look? Top-Down-Based Saliency Detection in a Traffic Driving Environment

Selective Attention-Based Saliency of Traffic Images and Characteristics of Eye Movement

Learning to Boost Bottom-Up Fixation Prediction in Driving Environments Via Random Forest.

Spatiotemporal Analysis of Static and Dynamic Traffic Elements from Road Scenes.

Visual Saliency Detection Based on Topographic Independent Component Analysis

How Do Drivers Allocate Their Potential Attention? Driving Fixation Prediction via Convolutional Neural Networks

Unifying Visual Saliency with HOG Feature Learning for Traffic Sign Detection

Tag-Saliency: Combining Bottom-Up and Top-Down Information for Saliency Detection

A visual attention based method for detecting traffic signs of interest

Traffic Sign Detection Based on Visual Co-Saliency in Complex Scenes

Fixated Object Detection Based on Saliency Prior in Traffic Scenes

A new representation of scene layout improves saliency detection in traffic scenes

Traffic Sign Detection And Recognition In Natural Scene Based On Human Visual Perception Mechanism

Visual Attention Model with a Novel Learning Strategy and Its Application to Target Detection from SAR Images.

Traffic Danger Detection by Visual Attention Model of Sparse Sampling

Visual attention computation in video of driving environment

Human-like Attention-Driven Saliency Object Estimation in Dynamic Driving Scenes

Learning to Model Task-Oriented Attention

TRAFFIC SIGN DETECTION BASED ON BIOLOGICALLY VISUAL MECHANISM

A Novel Target-Objected Visual Saliency Detection Model in Optical Satellite Images.