Abstract:Image demosaicking and denoising are the two key steps for color image production pipeline. The classical processing sequence consists of applying denoising first, and then demosaicking. However, this sequence leads to oversmoothing and unpleasant checkerboard effect. Moreover, it is very difficult to change this order, because once the image is demosaicked, the statistical properties of the noise will be changed dramatically. This is extremely challenging for traditional denoising models that strongly rely on statistical assumptions. In this paper, we attempt to tackle this prickly problem. Indeed, here we invert the traditional CFA processing pipeline by first demosaicking and then denoising. In the first stage, we design a demosaicking algorithm that combines traditional methods and a convolutional neural network (CNN) to reconstruct a full color image ignoring the noise. To improve the performance in image demosaicking, we modify an Inception architecture for fusing R, G and B three channels information. This stage retains all known information that is the key point to obtain pleasurable final results. After demosaicking, we get a noisy full-color image and use another CNN to learn the demosaicking residual noise (including artifacts) of it, that allows to obtain a restored full color image. Our proposed algorithm completely avoids the checkerboard effect and retains more image detail. Furthermore, it can process very high-level noise while the performances of other CNN based methods for noise higher than 20 are rather limited. Experimental results show clearly that our method outperforms state-of-the-art methods both quantitatively as well as in terms of visual quality.

Double Branch Residual Network for Demosaicing

Residual Learning for Effective Joint Demosaicing-Denoising

A Plug-and-play Demosaicing and Denoising Method on Mobile Cameras

An Efficient Transformer For Demosaicing Via Compressed Multi-Branch Attention Mechanism.

Color image demosaicking via deep residual learning

Learning to Joint Remosaic and Denoise in Quad Bayer CFA via Universal Multi-scale Channel Attention Network.

Deep Spatial Adaptive Network for Real Image Demosaicing.

Noise-Resistant Demosaicing with Deep Image Prior Network and Random RGBW Color Filter Array

PPI Edge Infused Spatial-Spectral Adaptive Residual Network for Multispectral Filter Array Image Demosaicing

Quad Bayer Joint Demosaicing and Denoising Based on Dual Encoder Network with Joint Residual Learning

Joint Demosaicking And Blind Deblurring Using Deep Convolutional Neural Network

DTDeMo: A Deep Learning-Based Two-Stage Image Demosaicing Model With Interpolation and Enhancement

Lightweight Deep Residue Learning for Joint Color Image Demosaicking and Denoising

Deep Color Image Demosaicking with Feature Pyramid Channel Attention

Joint Demosaicing and Denoising with Gradient Guidance in Quad Bayer CFA

MCFD: A Hardware-Efficient Noniterative Multicue Fusion Demosaicing Algorithm.

Learning Rich Information for Quad Bayer Remosaicing and Denoising.

Joint Demosaicing and Denoising with Double Deep Image Priors

A Study of Two CNN Demosaicking Algorithms

Joint Demosaicing and Denoising with Perceptual Optimization on a Generative Adversarial Network

Joint Demosaicking and Denoising Benefits from a Two-stage Training Strategy