Abstract:Existing image and video denoising algorithms have focused on removing homogeneous Gaussian noise. However, this assumption with noise modeling is often too simplistic for the characteristics of real-world noise. Moreover, the design of network architectures in most deep learning-based video denoising methods is heuristic, ignoring valuable domain knowledge. In this paper, we propose a model-guided deep unfolding network for the more challenging and realistic mixed noise video denoising problem, named DU-MVDnet. First, we develop a novel observation model/likelihood function based on the correlations among adjacent degraded frames. In the framework of Bayesian deep learning, we introduce a deep image denoiser prior and obtain an iterative optimization algorithm based on the maximum a posterior (MAP) estimation. To facilitate end-to-end optimization, the iterative algorithm is transformed into a deep convolutional neural network (DCNN)-based implementation. Furthermore, recognizing the limitations of traditional motion estimation and compensation methods, we propose an efficient multistage recursive fusion strategy to exploit temporal dependencies. Specifically, we divide video frames into several overlapping groups and progressively integrate these frames into one frame. Toward this objective, we implement a multiframe adaptive aggregation operation to integrate feature maps of intragroup with those of intergroup frames. Extensive experimental results on different video test datasets have demonstrated that the proposed model-guided deep network outperforms current state-of-the-art video denoising algorithms such as FastDVDnet and MAP-VDNet.

DEMC: A Deep Dual-Encoder Network for Denoising Monte Carlo Rendering

Image Denoising Via Multi-Scale Gated Fusion Network

Texture Compensation with Multi-Scale Dilated Residual Blocks for Image Denoising.

Fast Reconstruction for Monte Carlo Rendering Using Deep Convolutional Networks

Dilated Residual Encode-Decode Networks for Image Denoising

Adversarial Monte Carlo denoising with conditioned auxiliary feature modulation

DMCR-GAN: Adversarial Denoising for Monte Carlo Renderings with Residual Attention Networks and Hierarchical Features Modulation of Auxiliary Buffers

DECS-NET: CONVOLUTIONAL SELF-ENCODING NETWORK FOR HYPERSPECTRAL IMAGE DENOISING

Denoising Monte Carlo renderings via a multi-scale featured dual-residual GAN

Image Denoising Using Very Deep Fully Convolutional Encoder-Decoder Networks with Symmetric Skip Connections.

Denoising Deep Monte Carlo Renderings

A detail preserving neural network model for Monte Carlo denoising

Ensemble Denoising for Monte Carlo Renderings.

A survey on deep learning-based Monte Carlo denoising

Monte Carlo Denoising Via Multi-scale Auxiliary Feature Fusion Guided Transformer.

Multi-Scale and Kernel-Predicting Convolutional Networks for Monte Carlo Denoising.

FEMRNet: Feature-enhanced multi-scale residual network for image denoising

Deep residual learning for denoising Monte Carlo renderings

Dual-Complementary Convolution Network for Remote-Sensing Image Denoising

Deep Unfolding Network for Efficient Mixed Video Noise Removal.

A Multi-scale Dilated Residual Convolution Network for Image Denoising