Abstract:Image demosaicing and denoising are two important processes in the ISP pipeline of mobile cameras, because almost all mobile cameras in use today require colorful images generated by demosaicing algorithm, and the small sensor area of mobile cameras triggers low signal-to-noise ratio. Over the years, a considerable number of sequential demosaicing and denoising methods have been proposed, while they suffer from estimating the noise distribution and adjusting the hyper-parameters in order to balance demosaicing and denoising. There exit simultaneous demosaicing and denoising methods solving these problems. But they lack guidelines designed for mobile cameras. We propose a Plug-and-Play (PnP) demosaicing and denoising method on mobile cameras. Our method is built on PnP demosaicing framework which is derived from variable splitting theory. Any color demosaicing algorithm (i.e., bilinear, Malvar) can be plugged into our framework. We novelly trained an ISO conditioned denoiser for the framework and iteratively apply the denoiser in it. The ISO conditioned denoiser not only removes noise from the demosaicing procedure itself but also noise from camera sensors. By introducing ISO settings to the denoiser, our method takes possession of the adaptability and robustness in various capturing environments under different camera settings. Our method has only two hyperparameters to tune, which eases the hyper-parameter adjustment in sequential demosaicing and denoising methods. Extensive experiments on synthetic datasets show that our method performs better than sequential demosaicing and denoising methods and is practical for mobile cameras.

Image Filter Identification Using Demosaicing Residual Features

Source Camera Identification Using Support Vector Machines

Source Camera Identification Forensics Based on Wavelet Features

Detecting Image Tampering Using Feature Fusion

A Plug-and-play Demosaicing and Denoising Method on Mobile Cameras

Camera model identification framework using an ensemble of demosaicing features

Wavelet Frame Based Color Image Demosaicing

PPI Edge Infused Spatial-Spectral Adaptive Residual Network for Multispectral Filter Array Image Demosaicing

Joint Denoising and demosaicking of noisy CFA images based on inter-color correlation

Effective Color Filter Array Demosaicing Method

Color image demosaicking via deep residual learning

Automatic Design of Color Filter Arrays in the Frequency Domain

A Hybrid Polarization Image Demosaicking Algorithm Based on Inter-Channel Correlation

The Forchheim Image Database for Camera Identification in the Wild

Modified Newton-residual interpolation for division of focal plane polarization image demosaicking

Universal Demosaicking for Interpolation-Friendly RGBW Color Filter Arrays.

Universal Demosaicking of Color Filter Arrays

An end-to-end deep learning model for robust smooth filtering identification

Denoising Algorithm for CFA Image Sensors Considering Inter-Channel Correlation

Adaptive Multispectral Demosaicking Based on Frequency-Domain Analysis of Spectral Correlation

Universal Deep Demosaicking for Sparse Color Filter Arrays