Abstract:Vehicle detection and tracking play an important role in autonomous vehicles and intelligent transportation systems. Adverse weather conditions such as the presence of heavy snow, fog, rain, dust or sandstorm situations are dangerous restrictions on camera's function by reducing visibility, affecting driving safety. Indeed, these restrictions impact the performance of detection and tracking algorithms utilized in the traffic surveillance systems and autonomous driving applications. In this article, we start by proposing a visibility enhancement scheme consisting of three stages: illumination enhancement, reflection component enhancement, and linear weighted fusion to improve the performance. Then, we introduce a robust vehicle detection and tracking approach using a multi-scale deep convolution neural network. The conventional Gaussian mixture probability hypothesis density filter based tracker is utilized jointly with hierarchical data associations (HDA), which splits into detection-to-track and track-to-track associations. Herein, the cost matrix of each phase is solved using the Hungarian algorithm to compensate for the lost tracks caused by missed detection. Only detection information (i.e., bounding boxes with detection scores) is used in HDA without visual features information for rapid execution. We have also introduced a novel benchmarking dataset designed for research in applications of autonomous vehicles under adverse weather conditions called DAWN. It consists of real-world images collected with different types of adverse weather conditions. The proposed method is tested on DAWN, KITTI, and MS-COCO datasets and compared with 21 vehicle detectors. Experimental results have validated effectiveness of the proposed method which outperforms state-of-the-art vehicle detection and tracking approaches under adverse weather conditions.

Evaluation of a Time-Gated-Single-Pixel-Camera as a Promising Sensor for Autonomous Vehicles in Harsh Weather Conditions

Benchmarking Image Sensors Under Adverse Weather Conditions for Autonomous Driving

Embedded and Real-Time Vehicle Detection System for Challenging On-Road Scenes

Safe Autonomous Driving in Adverse Weather: Sensor Evaluation and Performance Monitoring

Traffic Sign Detection With Event Cameras and DCNN

Object Detection Method for Autonomous Vehicles in Adverse Weather

Vehicle Detection and Tracking in Adverse Weather Using a Deep Learning Framework

All-Weather Object Recognition Using Radar and Infrared Sensing

Analysis of Thermal Imaging Performance under Extreme Foggy Conditions: Applications to Autonomous Driving

Enhancing the Safety of Autonomous Vehicles in Adverse Weather by Deep Learning-Based Object Detection

A Real-Time Vehicle Detection System under Various Bad Weather Conditions Based on a Deep Learning Model without Retraining

Object Detection and Tracking for Autonomous Vehicles in Adverse Weather Conditions

Emergent Visual Sensors for Autonomous Vehicles

Real-Time Environment Condition Classification for Autonomous Vehicles

Optimizing Camera Exposure Time for Automotive Applications

Deep Learning-Based Object Detection and Scene Perception under Bad Weather Conditions

The Effect of Rainfall and Illumination on Automotive Sensors Detection Performance

Object Detection in Autonomous Vehicles under Adverse Weather: A Review of Traditional and Deep Learning Approaches

Snowy Scenes,Clear Detections: A Robust Model for Traffic Light Detection in Adverse Weather Conditions

Vision in adverse weather: Augmentation using CycleGANs with various object detectors for robust perception in autonomous racing

Spiking Neural Networks for Real-Time Pedestrian Street-Crossing Detection Using Dynamic Vision Sensors in Simulated Adverse Weather Conditions