Abstract:Polarization-based environmental perception is essential for intelligent vehicles. However, images taken in low-light conditions often have poor visibility. Deterioration of visual quality will decrease the accuracy of intelligent vehicle applications based on polarization, resulting in a decreased perception range and increased navigation risk. To suppress the effects of real-world nighttime scenes for intelligent vehicles, we propose a retinex-based polarization-aware low-light image enhancement network (RPLENet) that can enhance the polarization and color information. We prove that the reflectance layer obtained from the retinex decomposition of the unpolarized component <inline-formula xmlns:mml="http://www.w3.org/1998/Math/MathML" xmlns:xlink="http://www.w3.org/1999/xlink"><tex-math notation="LaTeX">$I_{un}$</tex-math></inline-formula> is more accurate than the reflectance layer from any polarizer angle intensity image. Therefore, we perform retinex decomposition on <inline-formula xmlns:mml="http://www.w3.org/1998/Math/MathML" xmlns:xlink="http://www.w3.org/1999/xlink"><tex-math notation="LaTeX">$I_{un}$</tex-math></inline-formula> to obtain a more precise reflectance layer instead of decomposing the reflectance layer in the polarizer angle intensity image. Our method achieves state-of-the-art performance by conducting extensive experiments on both synthetic and real-world datasets. We also collected polarization datasets from real-world nighttime road scenes to evaluate the performance of RPLENet. Our method can effectively improve the perception of polarization-based features in low-light conditions. This is of great value for the environmental robustness of visual perception systems and transportation safety. Our codes are available at <uri xmlns:mml="http://www.w3.org/1998/Math/MathML" xmlns:xlink="http://www.w3.org/1999/xlink">https://github.com/authorsdesk/RPLENet</uri> .

Polarization-aware Low-light Image Enhancement for Nighttime Intelligent Vehicles

ColorPolarNet: Residual Dense Network-Based Chromatic Intensity-Polarization Imaging in Low-Light Environment

Polarization-based Water Hazards Detection for Autonomous Off-Road Navigation

Predicting Polarization Beyond Semantics for Wearable Robotics.

Polarization-Aware Low-Light Image Enhancement

Exploiting Polarized Material Cues for Robust Car Detection

Polarization-Based Two-Stage Image Dehazing in a Low-Light Environment

Polarization of road target detection under complex weather conditions

Low-Light Sparse Polarization Demosaicing Network (LLSPD-Net): Polarization Image Demosaicing Based on Stokes Vector Completion in Low-Light Environment

Improving Monocular Depth Estimation in Traffic Scenarios by Polarization

Road scenes analysis in adverse weather conditions by polarization-encoded images and adapted deep learning

Low-Visibility Vehicle-Road Environment Perception Based on the Multi-Modal Visual Features Fusion of Polarization and Infrared

Augmenting Object Detection in Adverse Conditions with Polarization-Encoded Images

A Dual-Branch Autoencoder Network for Underwater Low-Light Polarized Image Enhancement

Fast Image Visibility Enhancement Based on Active Polarization and Color Constancy for Operation in Turbid Water

Illumination-invariant road detection and tracking using LWIR polarization characteristics

A Deep Retinex-Based Low-Light Enhancement Network Fusing Rich Intrinsic Prior Information

Polarimetric Imaging for Perception

Image dehazing combining polarization properties and deep learning.

U 2 PNet: An Unsupervised Underwater Image-Restoration Network Using Polarization

End-to-End Retinex-Based Illumination Attention Low-Light Enhancement Network for Autonomous Driving at Night