Abstract:Intelligent driver assistance systems are becoming increasingly popular in modern passenger vehicles. A crucial component of intelligent vehicles is the ability to detect vulnerable road users (VRUs) for an early and safe response. However, standard imaging sensors perform poorly in conditions of strong illumination contrast, such as approaching a tunnel or at night, due to their dynamic range limitations. In this paper, we focus on the use of high-dynamic-range (HDR) imaging sensors in vehicle perception systems and the subsequent need for tone mapping of the acquired data into a standard 8-bit representation. To our knowledge, no previous studies have evaluated the impact of tone mapping on object detection performance. We investigate the potential for optimizing HDR tone mapping to achieve a natural image appearance while facilitating object detection of state-of-the-art detectors designed for standard dynamic range (SDR) images. Our proposed approach relies on a lightweight convolutional neural network (CNN) that tone maps HDR video frames into a standard 8-bit representation. We introduce a novel training approach called detection-informed tone mapping (DI-TM) and evaluate its performance with respect to its effectiveness and robustness in various scene conditions, as well as its performance relative to an existing state-of-the-art tone mapping method. The results show that the proposed DI-TM method achieves the best results in terms of detection performance metrics in challenging dynamic range conditions, while both methods perform well in typical, non-challenging conditions. In challenging conditions, our method improves the detection F2 score by 13%. Compared to SDR images, the increase in F2 score is 49%.

High Dynamic Range Imaging Technology

A novel high dynamic range microscopic video system based on REC.2020

Tone reproduction of High Dynamic Image

Highly Robust Real-Time Image Enhancement

Enhancing the Surveillance Detection Range of Image Sensors Using HDR Techniques

Deep Learning for HDR Imaging: State-of-the-Art and Future Trends

Deep high dynamic range imaging of dynamic scenes

Event-based Asynchronous HDR Imaging by Temporal Incident Light Modulation

High Dynamic Range Image Capturing And Displaying

Photographic High-Dynamic-Range Scalar Visualization.

High-Dynamic-Range Spectral Imaging System for Omnidirectional Scene Capture

High dynamic range fusion for enhanced vision

HDR IMAGING FOR FEATURE DETECTION ON DETAILED ARCHITECTURAL SCENES

NTIRE 2021 Challenge on High Dynamic Range Imaging: Dataset, Methods and Results

High Dynamic Range Imaging via Visual Attention Modules

ArtHDR-Net: Perceptually Realistic and Accurate HDR Content Creation

Disparity-based HDR imaging

High-Dynamic-Range Tone Mapping in Intelligent Automotive Systems

HDRT: Infrared Capture for HDR Imaging