Abstract:Polarization imaging provides more dimensional information than traditional intensity imaging and has been widely used in both military and civil areas, such as battlefield reconnaissance, environmental monitoring, autonomous driving, and so on. With the rapid development of color polarization imaging sensors, polarization detection that allows simultaneous acquisition of multiple images (intensity maps modulated by different polarizers) and real-time extraction of polarization information is becoming increasingly mature. However, the imaging quality of color polarization camera is always unsatisfactory in low-light environment with low-photon count. In this article, we present a residual dense blocks (RDBs)-based multitask convolutional network, called ColorPolarNet, to extract and enhance the intensity and polarization information from four RGB polarized light intensity images captured in low-light environment with different polarization orientations (0°,45°,90°, and 135°). This proposed network consists of two parts: 1) an intensity network for initial denoising and color deviation correction of the four polarized light intensity maps and 2) a polarization network used to enhance the details of the total intensity ( ) map, the degree of linear polarization (DoLP) map, and the angle of polarization (AoP) map. Also, to train the model, we collect a low-light chromatic polarization (LLCP) dataset that contains 300 paired datasets of low-normal light images captured indoors and outdoors. Both qualitative and quantitative experimental results show that the proposed ColorPolarNet outperforms other conventional low-light image enhancement methods in terms of signal fidelity, contrast enhancement, and color reproduction. Our codes and the LLCP dataset are available at https://github.com/MinjieWan/C- lorPolarNet.

Convolutional Demosaicing Network for Joint Chromatic and Polarimetric Imagery

A Sparse Representation Based Joint Demosaicing Method for Single-Chip Polarized Color Sensor

Two-Step Color-Polarization Demosaicking Network

Learning a Non-Locally Regularized Convolutional Sparse Representation for Joint Chromatic and Polarimetric Demosaicking

ColorPolarNet: Residual Dense Network-Based Chromatic Intensity-Polarization Imaging in Low-Light Environment

Low-Light Sparse Polarization Demosaicing Network (LLSPD-Net): Polarization Image Demosaicing Based on Stokes Vector Completion in Low-Light Environment

A Plug-and-play Demosaicing and Denoising Method on Mobile Cameras

Deep convolutional demosaicking network for multispectral polarization filter array

Attention-Based Progressive Discrimination Generative Adversarial Networks for Polarimetric Image Demosaicing

A Hybrid Polarization Image Demosaicking Algorithm Based on Inter-Channel Correlation

PPI Edge Infused Spatial-Spectral Adaptive Residual Network for Multispectral Filter Array Image Demosaicing

Learning to Joint Remosaic and Denoise in Quad Bayer CFA via Universal Multi-scale Channel Attention Network.

Polarization Maintaining 3-D Convolutional Neural Network for Color Polarimetric Images Denoising

Deep Demosaicing for Polarimetric Filter Array Cameras

DPS-Net: Deep Polarimetric Stereo Depth Estimation

Polarized Intensity Ratio Constraint Demosaicing for the Division of a Focal-Plane Polarimetric Image

Color Polarization Image Super-Resolution Reconstruction via a Cross-Branch Supervised Learning Strategy

Joint Denoising-Demosaicking Network for Long-Wave Infrared Division-of-Focal-Plane Polarization Images With Mixed Noise Level Estimation

Simultaneous Acquisition of High Quality RGB Image and Polarization Information using a Sparse Polarization Sensor

Monochrome And Color Polarization Demosaicking Using Edge-Aware Residual Interpolation

Joint Demosaicing and Denoising with Gradient Guidance in Quad Bayer CFA