Abstract:With the growing popularity of smartphones, capturing high-quality images is of vital importance to smartphones. The cameras of smartphones have small apertures and small sensor cells, which lead to the noisy images in low light environment. Denoising based on a burst of multiple frames generally outperforms single frame denoising but with the larger compututional cost. In this paper, we propose an efficient yet effective burst denoising system. We adopt a three-stage design: noise prior integration, multi-frame alignment and multi-frame denoising. First, we integrate noise prior by pre-processing raw signals into a variance-stabilization space, which allows using a small-scale network to achieve competitive performance. Second, we observe that it is essential to adopt an explicit alignment for burst denoising, but it is not necessary to integrate a learning-based method to perform multi-frame alignment. Instead, we resort to a conventional and efficient alignment method and combine it with our multi-frame denoising network. At last, we propose a denoising strategy that processes multiple frames sequentially. Sequential denoising avoids filtering a large number of frames by decomposing multiple frames denoising into several efficient sub-network denoising. As for each sub-network, we propose an efficient multi-frequency denoising network to remove noise of different frequencies. Our three-stage design is efficient and shows strong performance on burst denoising. Experiments on synthetic and real raw datasets demonstrate that our method outperforms state-of-the-art methods, with less computational cost. Furthermore, the low complexity and high-quality performance make deployment on smartphones possible.

An Analysis and Implementation of the HDR+ Burst Denoising Method

A novel high dynamic range microscopic video system based on REC.2020

Dual-constraint Burst Image Denoising Method

A Plug-and-play Demosaicing and Denoising Method on Mobile Cameras

Efficient Burst Raw Denoising with Variance Stabilization and Multi-frequency Denoising Network

High Dynamic Range and Super-Resolution from Raw Image Bursts

Deep Burst Denoising

Exposure Diffusion: HDR Image Generation by Consistent LDR denoising

SJ-HD^2R: Selective Joint High Dynamic Range and Denoising Imaging for Dynamic Scenes

Joint denoising and HDR for RAW video sequences

Joint Denoising and HDR for RAW Image Sequences

Burst photography for high dynamic range and low-light imaging on mobile cameras

NTIRE 2021 Challenge on High Dynamic Range Imaging: Dataset, Methods and Results

CANDID: Correspondence AligNment for Deep-burst Image Denoising

End-to-End Denoising of Dark Burst Images Using Recurrent Fully Convolutional Networks

Best Algorithms for HDR Image Generation. A Study of Performance Bounds

Unified HDR reconstruction from raw CFA data

Joint HDR Denoising and Fusion: A Real-World Mobile HDR Image Dataset

Efficient HDR Reconstruction from Real-World Raw Images

Automatic exposure selection and fusion for high-dynamic-range photography via smartphones

RawHDR: High Dynamic Range Image Reconstruction from a Single Raw Image