Abstract:Color demosaicing is an essential step in the camera image processing pipeline, especially on hardware platforms for real-time video applications. Though many demosaicing algorithms have been proposed in the past two decades, there remains a substantial gap between industrial needs and academic research. On one hand, industry requires a high perceptual quality, artifact-free, and low-cost demosaicing algorithm that is noniterative and small window based ready to be implemented on a hardware platform with a limited line buffer. On the other hand, academia is targeting high PSNR/SSIM, with the computation cost and line buffer receiving second priority, and often a frame buffer and iterative operation are used. The cost, large line buffer and iteration requirement make most existing demosaicing algorithms inapplicable on hardware platforms. In this paper, we introduce a novel low-cost demosaicing algorithm to narrow the gap. We keep the operation window size and computation cost as the first priority and achieve both high PSNR/SSIM and visual perceptual quality compared to previous state-of-the-art methods on standard test datasets. We fully investigate the a priori knowledge of natural scene raw images and find several key cues that are beneficial to demosaicing. Our demosaicing algorithm is a smart fusion of these useful cues. Furthermore, we solve typical demosaicing issues that occur in many traditional methods, including false color artifacts, T-section closing, and zippering artifacts. The proposed method has no learning stage, no iteration operation, a small line buffer and a limited number of parameters, so it can easily be applied to hardware platforms.

LMMSE frequency merging for demosaicking

Image splicing localization based on re-demosaicing

Frequency Selection and Merging with Universal Matrices for Color Filter Array Demosaicking

Multi-focus Color Image Fusion in the HSI Space Using the Sum-Modified-laplacian and a Coarse Edge Map

Color demosaicking via fully directional estimation

Universal Demosaicking of Color Filter Arrays

MCFD: A Hardware-Efficient Noniterative Multicue Fusion Demosaicing Algorithm.

An Improved Color Image Demosaicking Algorithm

Optimized High-Frequency Based Interpolation for Multispectral Demosaicking

An Efficient Transformer For Demosaicing Via Compressed Multi-Branch Attention Mechanism.

An LMMSE-based merging approach for subpixel-based downsampling

Joint learning of RGBW color filter arrays and demosaicking

Multispectral Demosaicing Based on Iterative-Linear-Regression Model for Estimating Pseudo-Panchromatic Image

PPI Edge Infused Spatial-Spectral Adaptive Residual Network for Multispectral Filter Array Image Demosaicing

Adaptive Multispectral Demosaicking Based on Frequency-Domain Analysis of Spectral Correlation

An Efficient Adaptive Interpolation for Bayer CFA Demosaicking

A Sparse Representation Based Joint Demosaicing Method for Single-Chip Polarized Color Sensor

Joint Denoising and demosaicking of noisy CFA images based on inter-color correlation

Model-based demosaicking for acquisitions by a RGBW color filter array

Bayer Demosaicking With Polynomial Interpolation