Abstract:Image demosaicing and denoising are two important processes in the ISP pipeline of mobile cameras, because almost all mobile cameras in use today require colorful images generated by demosaicing algorithm, and the small sensor area of mobile cameras triggers low signal-to-noise ratio. Over the years, a considerable number of sequential demosaicing and denoising methods have been proposed, while they suffer from estimating the noise distribution and adjusting the hyper-parameters in order to balance demosaicing and denoising. There exit simultaneous demosaicing and denoising methods solving these problems. But they lack guidelines designed for mobile cameras. We propose a Plug-and-Play (PnP) demosaicing and denoising method on mobile cameras. Our method is built on PnP demosaicing framework which is derived from variable splitting theory. Any color demosaicing algorithm (i.e., bilinear, Malvar) can be plugged into our framework. We novelly trained an ISO conditioned denoiser for the framework and iteratively apply the denoiser in it. The ISO conditioned denoiser not only removes noise from the demosaicing procedure itself but also noise from camera sensors. By introducing ISO settings to the denoiser, our method takes possession of the adaptability and robustness in various capturing environments under different camera settings. Our method has only two hyperparameters to tune, which eases the hyper-parameter adjustment in sequential demosaicing and denoising methods. Extensive experiments on synthetic datasets show that our method performs better than sequential demosaicing and denoising methods and is practical for mobile cameras.

Joint demosaicing and denoising of noisy bayer images with ADMM

Spatial-Adaptive Network for Single Image Denoising

A Plug-and-play Demosaicing and Denoising Method on Mobile Cameras

Joint Demosaicing and Denoising with Double Deep Image Priors

Frequency-Relevant Residual Learning for Multi-Modal Image Denoising.

Joint Demosaicing and Denoising with Gradient Guidance in Quad Bayer CFA

Learning to Joint Remosaic and Denoise in Quad Bayer CFA via Universal Multi-scale Channel Attention Network.

Hardware-Oriented Shallow Joint Demosaicing and Denoising.

Adversarial Monte Carlo denoising with conditioned auxiliary feature modulation

Two-Stage CNN Model for Joint Demosaicing and Denoising of Burst Bayer Images

Joint Demosaicking and Denoising Benefits from a Two-stage Training Strategy

Adaptive joint demosaicing and Subpixel-based Down-sampling for Bayer image

Joint Denoising and demosaicking of noisy CFA images based on inter-color correlation

Inheriting Bayer's Legacy-Joint Remosaicing and Denoising for Quad Bayer Image Sensor

How to Best Combine Demosaicing and Denoising?

Inheriting Bayer's Legacy: Joint Remosaicing and Denoising for Quad Bayer Image Sensor

Joint image denoising using adaptive principal component analysis and self-similarity

Joint Demosaicing and Subpixel-Based Down-Sampling for Bayer Images: A Fast Frequency-Domain Analysis Approach

Joint Demosaicking and Denoising in the Wild: The Case of Training Under Ground Truth Uncertainty

Learning Raw Image Denoising With Bayer Pattern Unification and Bayer Preserving Augmentation

An Iterative Robust Kernel-Based Regression Method for Simultaneous Single Image Super-Resolution and Denoising