Abstract:Polarization imaging beyond traditional imaging offers a wide range of advantages, encompassing not only the detection of geometric shapes and surfaces, but also the measurement of physical properties. The divided focal plane (DoFP), an ideal real-time imaging, comprises a 2 × 2 linear polarization filter overlaid on a focal plane array sensor. Consequently, performing polarization demosaicing (PDM) becomes crucial to restore the missing components in the pixel data. The objective of PDM extends beyond the acquisition of intensity, and its primary goal is to minimize the estimation error of polarization characteristics. However, existing demosaicing networks often neglect the issues of polarization spatial-intensity attention and are trained similarly for generalization, thereby failing to effectively distinguish between genuine details and artifacts, which renders demosaicing vulnerable to distortion. In this work, we propose a novel generative adversarial network framework that integrates attention mechanisms and progressive discrimination for polarimetric images. The GAN-based framework introduces a global attention mechanism that enhances the interaction between spatial and polarization intensity information across different regions, resulting in improved network performance. Additionally, the framework generates artifact maps to normalize the model training process. To evaluate the effectiveness of our method, we assess its performance using full-resolution polarimetric image and compare it against traditional and recent PDM methods. The experimental results demonstrate that our proposed method achieves the highest peak signal-to-noise ratio (PSNR) and exhibits excellent visual quality for the output Stokes images when compared to existing methods.

No-Reference Physics-Based Quality Assessment of Polarization Images and Its Application to Demosaicking

A Hybrid Polarization Image Demosaicking Algorithm Based on Inter-Channel Correlation

Polarization image demosaicking based on homogeneity space

Polarized Intensity Ratio Constraint Demosaicing for the Division of a Focal-Plane Polarimetric Image

A New Polarization Image Demosaicking Method In The Frequency Domain For Dofp Polarization Imaging

Efficient Polarization Demosaicking via Low-cost Edge-aware and Inter-channel Correlation

Polarization Image Demosaicking Via Nonlocal Sparse Tensor Factorization.

Polarization Image Demosaicking Using Polarization Channel Difference Prior

Three-Stage Interpolation Method for Demosaicking Monochrome Polarization DoFP Images

Image Interpolation Methods for Division of Focal Plane Polarimeters: a Review

Monochrome And Color Polarization Demosaicking Using Edge-Aware Residual Interpolation

Modified Newton-residual interpolation for division of focal plane polarization image demosaicking

Demosaicking DoFP Images Using Newton's Polynomial Interpolation and Polarization Difference Model.

New Polarization Imaging Method Based on Spatially Adaptive Wavelet Image Fusion

Joint Denoising-Demosaicking Network for Long-Wave Infrared Division-of-Focal-Plane Polarization Images With Mixed Noise Level Estimation

A Demosaicking Method Based on an Inter-Channel Correlation Model for DoFP Polarimeter

Sparse Representation-Based Demosaicking Method for Joint Chromatic and Polarimetric Imagery

Low-Light Sparse Polarization Demosaicing Network (LLSPD-Net): Polarization Image Demosaicing Based on Stokes Vector Completion in Low-Light Environment

Polarization-Aware Low-Light Image Enhancement

Real-time Underwater Polarization Imaging Without Relying on Background

Attention-Based Progressive Discrimination Generative Adversarial Networks for Polarimetric Image Demosaicing