Abstract:Polarization imaging provides more dimensional information than traditional intensity imaging and has been widely used in both military and civil areas, such as battlefield reconnaissance, environmental monitoring, autonomous driving, and so on. With the rapid development of color polarization imaging sensors, polarization detection that allows simultaneous acquisition of multiple images (intensity maps modulated by different polarizers) and real-time extraction of polarization information is becoming increasingly mature. However, the imaging quality of color polarization camera is always unsatisfactory in low-light environment with low-photon count. In this article, we present a residual dense blocks (RDBs)-based multitask convolutional network, called ColorPolarNet, to extract and enhance the intensity and polarization information from four RGB polarized light intensity images captured in low-light environment with different polarization orientations (0°,45°,90°, and 135°). This proposed network consists of two parts: 1) an intensity network for initial denoising and color deviation correction of the four polarized light intensity maps and 2) a polarization network used to enhance the details of the total intensity ( ) map, the degree of linear polarization (DoLP) map, and the angle of polarization (AoP) map. Also, to train the model, we collect a low-light chromatic polarization (LLCP) dataset that contains 300 paired datasets of low-normal light images captured indoors and outdoors. Both qualitative and quantitative experimental results show that the proposed ColorPolarNet outperforms other conventional low-light image enhancement methods in terms of signal fidelity, contrast enhancement, and color reproduction. Our codes and the LLCP dataset are available at https://github.com/MinjieWan/C- lorPolarNet.

Color Polarization Image Super-Resolution Reconstruction via a Cross-Branch Supervised Learning Strategy

Predicting Polarization Beyond Semantics for Wearable Robotics.

ColorPolarNet: Residual Dense Network-Based Chromatic Intensity-Polarization Imaging in Low-Light Environment

SCSNet: an Efficient Paradigm for Learning Simultaneously Image Colorization and Super-resolution

Simultaneous Acquisition of High Quality RGB Image and Polarization Information using a Sparse Polarization Sensor

Calculation and restoration of lost spatial information in division-of-focal-plane polarization remote sensing using polarization super-resolution technology

Learning a Non-Locally Regularized Convolutional Sparse Representation for Joint Chromatic and Polarimetric Demosaicking

Color Polarization Demosaicking by a Convolutional Neural Network

DPS-Net: Deep Polarimetric Stereo Depth Estimation

Sentinel-1 Dual-Polarization SAR Images Despeckling Network Based on Unsupervised Learning

Convolutional Demosaicing Network for Joint Chromatic and Polarimetric Imagery

Multi-scale Adaptive Weighted Network for Polarization Computational Imaging Super-Resolution

Low-Light Sparse Polarization Demosaicing Network (LLSPD-Net): Polarization Image Demosaicing Based on Stokes Vector Completion in Low-Light Environment

A Hybrid Polarization Image Demosaicking Algorithm Based on Inter-Channel Correlation

Polarization Super-Resolution Imaging Method Based on Deep Compressed Sensing

Two-Step Color-Polarization Demosaicking Network

Polarization Maintaining 3-D Convolutional Neural Network for Color Polarimetric Images Denoising

Polarization Guided HDR Reconstruction Via Pixel-Wise Depolarization

Learning to Deblur Polarized Images

Sky Polarization Pattern Reconstruction and Neutral Line Detection Based on Adversarial Learning.

SAR Image Colorization: Converting Single-Polarization to Fully Polarimetric Using Deep Neural Networks