Abstract:Polarization imaging beyond traditional imaging offers a wide range of advantages, encompassing not only the detection of geometric shapes and surfaces, but also the measurement of physical properties. The divided focal plane (DoFP), an ideal real-time imaging, comprises a 2 × 2 linear polarization filter overlaid on a focal plane array sensor. Consequently, performing polarization demosaicing (PDM) becomes crucial to restore the missing components in the pixel data. The objective of PDM extends beyond the acquisition of intensity, and its primary goal is to minimize the estimation error of polarization characteristics. However, existing demosaicing networks often neglect the issues of polarization spatial-intensity attention and are trained similarly for generalization, thereby failing to effectively distinguish between genuine details and artifacts, which renders demosaicing vulnerable to distortion. In this work, we propose a novel generative adversarial network framework that integrates attention mechanisms and progressive discrimination for polarimetric images. The GAN-based framework introduces a global attention mechanism that enhances the interaction between spatial and polarization intensity information across different regions, resulting in improved network performance. Additionally, the framework generates artifact maps to normalize the model training process. To evaluate the effectiveness of our method, we assess its performance using full-resolution polarimetric image and compare it against traditional and recent PDM methods. The experimental results demonstrate that our proposed method achieves the highest peak signal-to-noise ratio (PSNR) and exhibits excellent visual quality for the output Stokes images when compared to existing methods.

A Demosaicking Method Based on an Inter-Channel Correlation Model for DoFP Polarimeter

Efficient Polarization Demosaicking via Low-cost Edge-aware and Inter-channel Correlation

A Hybrid Polarization Image Demosaicking Algorithm Based on Inter-Channel Correlation

Analysis of the Distribution Characteristics of the States of Polarization Based on Improved Delaunay Triangulation Algorithm

Three-Stage Interpolation Method for Demosaicking Monochrome Polarization DoFP Images

Demosaicking DoFP images using edge compensation method based on correlation

Polarized Intensity Ratio Constraint Demosaicing for the Division of a Focal-Plane Polarimetric Image

Polarization image demosaicking based on homogeneity space

A Sparse Representation Based Joint Demosaicing Method for Single-Chip Polarized Color Sensor

Modified Newton-residual interpolation for division of focal plane polarization image demosaicking

Monochrome And Color Polarization Demosaicking Using Edge-Aware Residual Interpolation

Learning a Non-Locally Regularized Convolutional Sparse Representation for Joint Chromatic and Polarimetric Demosaicking

Residual Interpolation Integrated Pixel-by-Pixel Adaptive Iterative Process for Division of Focal Plane Polarimeters

Joint Denoising-Demosaicking Network for Long-Wave Infrared Division-of-Focal-Plane Polarization Images With Mixed Noise Level Estimation

Deep Demosaicing for Polarimetric Filter Array Cameras

Four-Directional Adaptive Residual Interpolation Technique for DoFP Polarimeters With Different Micro-Polarizer Patterns

Attention-Based Progressive Discrimination Generative Adversarial Networks for Polarimetric Image Demosaicing

Real-Time Polarization Spectral Detection Based on a Dual-Dispersion and Coded-Aperture Imaging System.

Color polarization imaging demosaicing based on Stokes vector information complementation and fusion

Low-Light Sparse Polarization Demosaicing Network (LLSPD-Net): Polarization Image Demosaicing Based on Stokes Vector Completion in Low-Light Environment

Demosaicking Based on Channel-Correlation Adaptive Dictionary Learning