Abstract:Vehicle detection and tracking play an important role in autonomous vehicles and intelligent transportation systems. Adverse weather conditions such as the presence of heavy snow, fog, rain, dust or sandstorm situations are dangerous restrictions on camera's function by reducing visibility, affecting driving safety. Indeed, these restrictions impact the performance of detection and tracking algorithms utilized in the traffic surveillance systems and autonomous driving applications. In this article, we start by proposing a visibility enhancement scheme consisting of three stages: illumination enhancement, reflection component enhancement, and linear weighted fusion to improve the performance. Then, we introduce a robust vehicle detection and tracking approach using a multi-scale deep convolution neural network. The conventional Gaussian mixture probability hypothesis density filter based tracker is utilized jointly with hierarchical data associations (HDA), which splits into detection-to-track and track-to-track associations. Herein, the cost matrix of each phase is solved using the Hungarian algorithm to compensate for the lost tracks caused by missed detection. Only detection information (i.e., bounding boxes with detection scores) is used in HDA without visual features information for rapid execution. We have also introduced a novel benchmarking dataset designed for research in applications of autonomous vehicles under adverse weather conditions called DAWN. It consists of real-world images collected with different types of adverse weather conditions. The proposed method is tested on DAWN, KITTI, and MS-COCO datasets and compared with 21 vehicle detectors. Experimental results have validated effectiveness of the proposed method which outperforms state-of-the-art vehicle detection and tracking approaches under adverse weather conditions.

Learning to Remove Bad Weather: Towards Robust Visual Perception for Self-Driving

Task-Driven Deep Image Enhancement Network for Autonomous Driving in Bad Weather

Enhancing autonomous vehicle safety in rain: a data-centric approach for clear vision

Robust Perception under Adverse Conditions for Autonomous Driving Based on Data Augmentation

AllWeatherNet:Unified Image enhancement for autonomous driving under adverse weather and lowlight-conditions

An Interpretable Image Denoising Framework Via Dual Disentangled Representation Learning

Image Deraining and Denoising Convolutional Neural Network ForAutonomous Driving

Image Deraining Convolutional Neural Network ForAutonomous Driving

Gated Adversarial Network Based Environmental Enhancement Method for Driving Safety under Adverse Weather Conditions.

Doubly Contrastive End-to-End Semantic Segmentation for Autonomous Driving under Adverse Weather

RainSD: Rain Style Diversification Module for Image Synthesis Enhancement using Feature-Level Style Distribution

Enhancing Autonomous Vehicle Perception in Adverse Weather through Image Augmentation during Semantic Segmentation Training

Image Deraining and Denoising Convolutional Neural Network For Autonomous Driving

Robust autonomous driving control using deep hybrid-learning network under rainy/snown conditions

Mastering adverse weather: a two-stage approach for robust semantic segmentation in autonomous driving

Robust ADAS: Enhancing Robustness of Machine Learning-based Advanced Driver Assistance Systems for Adverse Weather

Framework of degraded image restoration and simultaneous localization and mapping for multiple bad weather conditions

A Real-Time Vehicle Detection System under Various Bad Weather Conditions Based on a Deep Learning Model without Retraining

Deep Learning-Based Object Detection and Scene Perception under Bad Weather Conditions

NiteDR: Nighttime Image De-Raining with Cross-View Sensor Cooperative Learning for Dynamic Driving Scenes

Vehicle Detection and Tracking in Adverse Weather Using a Deep Learning Framework