Abstract:Polarization imaging beyond traditional imaging offers a wide range of advantages, encompassing not only the detection of geometric shapes and surfaces, but also the measurement of physical properties. The divided focal plane (DoFP), an ideal real-time imaging, comprises a 2 × 2 linear polarization filter overlaid on a focal plane array sensor. Consequently, performing polarization demosaicing (PDM) becomes crucial to restore the missing components in the pixel data. The objective of PDM extends beyond the acquisition of intensity, and its primary goal is to minimize the estimation error of polarization characteristics. However, existing demosaicing networks often neglect the issues of polarization spatial-intensity attention and are trained similarly for generalization, thereby failing to effectively distinguish between genuine details and artifacts, which renders demosaicing vulnerable to distortion. In this work, we propose a novel generative adversarial network framework that integrates attention mechanisms and progressive discrimination for polarimetric images. The GAN-based framework introduces a global attention mechanism that enhances the interaction between spatial and polarization intensity information across different regions, resulting in improved network performance. Additionally, the framework generates artifact maps to normalize the model training process. To evaluate the effectiveness of our method, we assess its performance using full-resolution polarimetric image and compare it against traditional and recent PDM methods. The experimental results demonstrate that our proposed method achieves the highest peak signal-to-noise ratio (PSNR) and exhibits excellent visual quality for the output Stokes images when compared to existing methods.

Efficient Polarization Demosaicking via Low-cost Edge-aware and Inter-channel Correlation

A Hybrid Polarization Image Demosaicking Algorithm Based on Inter-Channel Correlation

Three-Stage Interpolation Method for Demosaicking Monochrome Polarization DoFP Images

Polarization image demosaicking based on homogeneity space

Polarized Intensity Ratio Constraint Demosaicing for the Division of a Focal-Plane Polarimetric Image

Modified Newton-residual interpolation for division of focal plane polarization image demosaicking

Demosaicking DoFP images using edge compensation method based on correlation

Monochrome And Color Polarization Demosaicking Using Edge-Aware Residual Interpolation

A Sparse Representation Based Joint Demosaicing Method for Single-Chip Polarized Color Sensor

Low-Light Sparse Polarization Demosaicing Network (LLSPD-Net): Polarization Image Demosaicing Based on Stokes Vector Completion in Low-Light Environment

Deep Demosaicing for Polarimetric Filter Array Cameras

Attention-Based Progressive Discrimination Generative Adversarial Networks for Polarimetric Image Demosaicing

MCFD: A Hardware-Efficient Noniterative Multicue Fusion Demosaicing Algorithm.

Bayer Demosaicking With Polynomial Interpolation

Residual Interpolation Integrated Pixel-by-Pixel Adaptive Iterative Process for Division of Focal Plane Polarimeters

Learning a Non-Locally Regularized Convolutional Sparse Representation for Joint Chromatic and Polarimetric Demosaicking

Real-Time Polarization Spectral Detection Based on a Dual-Dispersion and Coded-Aperture Imaging System.

Low Cost Edge Sensing for High Quality Demosaicking

Two-Step Color-Polarization Demosaicking Network

An Efficient Adaptive Interpolation for Bayer CFA Demosaicking

Four-Directional Adaptive Residual Interpolation Technique for DoFP Polarimeters With Different Micro-Polarizer Patterns