Abstract:Image demosaicking and denoising are the two key steps for color image production pipeline. The classical processing sequence consists of applying denoising first, and then demosaicking. However, this sequence leads to oversmoothing and unpleasant checkerboard effect. Moreover, it is very difficult to change this order, because once the image is demosaicked, the statistical properties of the noise will be changed dramatically. This is extremely challenging for traditional denoising models that strongly rely on statistical assumptions. In this paper, we attempt to tackle this prickly problem. Indeed, here we invert the traditional CFA processing pipeline by first demosaicking and then denoising. In the first stage, we design a demosaicking algorithm that combines traditional methods and a convolutional neural network (CNN) to reconstruct a full color image ignoring the noise. To improve the performance in image demosaicking, we modify an Inception architecture for fusing R, G and B three channels information. This stage retains all known information that is the key point to obtain pleasurable final results. After demosaicking, we get a noisy full-color image and use another CNN to learn the demosaicking residual noise (including artifacts) of it, that allows to obtain a restored full color image. Our proposed algorithm completely avoids the checkerboard effect and retains more image detail. Furthermore, it can process very high-level noise while the performances of other CNN based methods for noise higher than 20 are rather limited. Experimental results show clearly that our method outperforms state-of-the-art methods both quantitatively as well as in terms of visual quality.

A Study of Two CNN Demosaicking Algorithms

Color image demosaicking via deep residual learning

Residual Learning for Effective Joint Demosaicing-Denoising

A Plug-and-play Demosaicing and Denoising Method on Mobile Cameras

Deep Color Image Demosaicking with Feature Pyramid Channel Attention

Joint Demosaicking and Denoising Benefits from a Two-stage Training Strategy

Channel-by-Channel Demosaicking Networks with Embedded Spectral Correlation

A Two-Stage Convolutional Neural Network for Joint Demosaicking and Super-Resolution

Deep joint demosaicking and denoising

Joint Demosaicking and Denoising by Fine-Tuning of Bursts of Raw Images

An Improved Color Image Demosaicking Algorithm

How to Best Combine Demosaicing and Denoising?

A Mathematical Analysis and Implementation of Residual Interpolation Demosaicking Algorithms

Toward Moiré-Free and Detail-Preserving Demosaicking

Cross-Channel Correlation Preserved Three-Stream Lightweight CNNs for Demosaicking

Joint Demosaicking And Blind Deblurring Using Deep Convolutional Neural Network

Cross-Channel Correlation Preserved Three-Stream Lightweight CNNs for Demosaicking.

Double Branch Residual Network for Demosaicing

An Efficient Transformer For Demosaicing Via Compressed Multi-Branch Attention Mechanism.

A Snapshot Near-Infrared Hyperspectral Demosaicing Method with Convolutional Neural Networks in Low Illumination Environment

Lightweight Deep Residue Learning for Joint Color Image Demosaicking and Denoising