Abstract:Modern digital cameras rely on the sequential execution of separate image processing steps to produce realistic images. The first two steps are usually related to denoising and demosaicking where the former aims to reduce noise from the sensor and the latter converts a series of light intensity readings to color images. Modern approaches try to jointly solve these problems, i.e. joint denoising-demosaicking which is an inherently ill-posed problem given that two-thirds of the intensity information is missing and the rest are perturbed by noise. While there are several machine learning systems that have been recently introduced to solve this problem, the majority of them relies on generic network architectures which do not explicitly take into account the physical image model. In this work we propose a novel algorithm which is inspired by powerful classical image regularization methods, large-scale optimization, and deep learning techniques. Consequently, our derived iterative optimization algorithm, which involves a trainable denoising network, has a transparent and clear interpretation compared to other black-box data driven approaches. Our extensive experimentation line demonstrates that our proposed method outperforms any previous approaches for both noisy and noise-free data across many different datasets. This improvement in reconstruction quality is attributed to the rigorous derivation of an iterative solution and the principled way we design our denoising network architecture, which as a result requires fewer trainable parameters than the current state-of-the-art solution and furthermore can be efficiently trained by using a significantly smaller number of training data than existing deep demosaicking networks.

Residual Learning for Effective Joint Demosaicing-Denoising

Joint Demosaicking and Denoising Benefits from a Two-stage Training Strategy

A Plug-and-play Demosaicing and Denoising Method on Mobile Cameras

Texture Compensation with Multi-Scale Dilated Residual Blocks for Image Denoising.

Frequency-Relevant Residual Learning for Multi-Modal Image Denoising.

How to Best Combine Demosaicing and Denoising?

Color image demosaicking via deep residual learning

Lightweight Deep Residue Learning for Joint Color Image Demosaicking and Denoising

Iterative Joint Image Demosaicking and Denoising using a Residual Denoising Network

Double Branch Residual Network for Demosaicing

Learning to Joint Remosaic and Denoise in Quad Bayer CFA via Universal Multi-scale Channel Attention Network.

A Study of Two CNN Demosaicking Algorithms

Joint Denoising and demosaicking of noisy CFA images based on inter-color correlation

Dilated Residual Encode-Decode Networks for Image Denoising

Toward Blind Joint Demosaicing and Denoising of Raw Color Filter Array Data.

Joint Denoising and Demosaicking With Green Channel Prior for Real-World Burst Images

Hierarchical Residual Learning for Image Denoising

Noise-Resistant Demosaicing with Deep Image Prior Network and Random RGBW Color Filter Array

Joint Image Denoising and Demosaicking by Low Rank Approximation and Color Difference Model

A Review of an Old Dilemma: Demosaicking First, or Denoising First?

Joint Demosaicking And Blind Deblurring Using Deep Convolutional Neural Network