Abstract:Polarization imaging beyond traditional imaging offers a wide range of advantages, encompassing not only the detection of geometric shapes and surfaces, but also the measurement of physical properties. The divided focal plane (DoFP), an ideal real-time imaging, comprises a 2 × 2 linear polarization filter overlaid on a focal plane array sensor. Consequently, performing polarization demosaicing (PDM) becomes crucial to restore the missing components in the pixel data. The objective of PDM extends beyond the acquisition of intensity, and its primary goal is to minimize the estimation error of polarization characteristics. However, existing demosaicing networks often neglect the issues of polarization spatial-intensity attention and are trained similarly for generalization, thereby failing to effectively distinguish between genuine details and artifacts, which renders demosaicing vulnerable to distortion. In this work, we propose a novel generative adversarial network framework that integrates attention mechanisms and progressive discrimination for polarimetric images. The GAN-based framework introduces a global attention mechanism that enhances the interaction between spatial and polarization intensity information across different regions, resulting in improved network performance. Additionally, the framework generates artifact maps to normalize the model training process. To evaluate the effectiveness of our method, we assess its performance using full-resolution polarimetric image and compare it against traditional and recent PDM methods. The experimental results demonstrate that our proposed method achieves the highest peak signal-to-noise ratio (PSNR) and exhibits excellent visual quality for the output Stokes images when compared to existing methods.

Three-Stage Interpolation Method for Demosaicking Monochrome Polarization DoFP Images

A Hybrid Polarization Image Demosaicking Algorithm Based on Inter-Channel Correlation

Efficient Polarization Demosaicking via Low-cost Edge-aware and Inter-channel Correlation

Monochrome And Color Polarization Demosaicking Using Edge-Aware Residual Interpolation

Polarization image demosaicking based on homogeneity space

Modified Newton-residual interpolation for division of focal plane polarization image demosaicking

Polarized Intensity Ratio Constraint Demosaicing for the Division of a Focal-Plane Polarimetric Image

A Sparse Representation Based Joint Demosaicing Method for Single-Chip Polarized Color Sensor

The Method Of Infrared Polariametric Imaging

Demosaicking DoFP images using edge compensation method based on correlation

Low-Light Sparse Polarization Demosaicing Network (LLSPD-Net): Polarization Image Demosaicing Based on Stokes Vector Completion in Low-Light Environment

Attention-Based Progressive Discrimination Generative Adversarial Networks for Polarimetric Image Demosaicing

Joint Denoising-Demosaicking Network for Long-Wave Infrared Division-of-Focal-Plane Polarization Images With Mixed Noise Level Estimation

Four-Directional Adaptive Residual Interpolation Technique for DoFP Polarimeters With Different Micro-Polarizer Patterns

Deep Demosaicing for Polarimetric Filter Array Cameras

BM3D-based denoising method for color polarization filter array

Bayer Demosaicking With Polynomial Interpolation

Residual Interpolation Integrated Pixel-by-Pixel Adaptive Iterative Process for Division of Focal Plane Polarimeters

Two-Step Color-Polarization Demosaicking Network

Learning a Non-Locally Regularized Convolutional Sparse Representation for Joint Chromatic and Polarimetric Demosaicking

Color polarization imaging demosaicing based on Stokes vector information complementation and fusion