Abstract:With the growing popularity of smartphones, capturing high-quality images is of vital importance to smartphones. The cameras of smartphones have small apertures and small sensor cells, which lead to the noisy images in low light environment. Denoising based on a burst of multiple frames generally outperforms single frame denoising but with the larger compututional cost. In this paper, we propose an efficient yet effective burst denoising system. We adopt a three-stage design: noise prior integration, multi-frame alignment and multi-frame denoising. First, we integrate noise prior by pre-processing raw signals into a variance-stabilization space, which allows using a small-scale network to achieve competitive performance. Second, we observe that it is essential to adopt an explicit alignment for burst denoising, but it is not necessary to integrate a learning-based method to perform multi-frame alignment. Instead, we resort to a conventional and efficient alignment method and combine it with our multi-frame denoising network. At last, we propose a denoising strategy that processes multiple frames sequentially. Sequential denoising avoids filtering a large number of frames by decomposing multiple frames denoising into several efficient sub-network denoising. As for each sub-network, we propose an efficient multi-frequency denoising network to remove noise of different frequencies. Our three-stage design is efficient and shows strong performance on burst denoising. Experiments on synthetic and real raw datasets demonstrate that our method outperforms state-of-the-art methods, with less computational cost. Furthermore, the low complexity and high-quality performance make deployment on smartphones possible.

Multiple Forward-Backward Strategies for Two-Stage Video Denoising

Adaptive fuzzy filter algorithm for real-time video denoising

Denoising Adversarial Networks for Rain Removal and Reflection Removal.

First image then video: A two-stage network for spatiotemporal video denoising

An Adaptive Image Denoising Method Based on Deep Rectified Denoising Auto-Encoder

Deep Unfolding Network for Efficient Mixed Video Noise Removal.

A Multi-scale Video Denoising Algorithm for Raw Image

Adaptive Image Denoising Based on Improved Stacked Sparse Denoising Auto-Encoder

Learning Model-Blind Temporal Denoisers without Ground Truths

Learning Task-Oriented Flows to Mutually Guide Feature Alignment in Synthesized and Real Video Denoising

Unidirectional Video Denoising by Mimicking Backward Recurrent Modules with Look-ahead Forward Ones

Real-time Video Denoising Arithmetic Based on Adaptive Multi-Layers Background

An Efficient Method for Traffic Image Denoising

An Adaptive Video Sequence Denoising Algorithm

Video Noise Removal Using Progressive Decomposition With Conditional Invertibility

Coding Trajectory: Enable Video Coding for Video Denoising.

Efficient Burst Raw Denoising with Variance Stabilization and Multi-frequency Denoising Network

Real-time Streaming Video Denoising with Bidirectional Buffers

Recursive Video Denoising Algorithm for Low Light Surveillance Applications

Towards Real-World Video Denosing: A Practical Video Denosing Dataset and Network

Two-stage Progressive Residual Dense Attention Network for Image Denoising