Abstract:Image denoising is a fundamental and challenging task in the field of computer vision. Most supervised denoising methods learn to reconstruct clean images from noisy inputs, which have intrinsic spectral bias and tend to produce over-smoothed and blurry images. Recently, researchers have explored diffusion models to generate high-frequency details in image restoration tasks, but these models do not guarantee that the generated texture aligns with real images, leading to undesirable artifacts. To address the trade-off between visual appeal and fidelity of high-frequency details in denoising tasks, we propose a novel approach called the Reconstruct-and-Generate Diffusion Model (RnG). Our method leverages a reconstructive denoising network to recover the majority of the underlying clean signal, which serves as the initial estimation for subsequent steps to maintain fidelity. Additionally, it employs a diffusion algorithm to generate residual high-frequency details, thereby enhancing visual quality. We further introduce a two-stage training scheme to ensure effective collaboration between the reconstructive and generative modules of RnG. To reduce undesirable texture introduced by the diffusion model, we also propose an adaptive step controller that regulates the number of inverse steps applied by the diffusion model, allowing control over the level of high-frequency details added to each patch as well as saving the inference computational cost. Through our proposed RnG, we achieve a better balance between perception and distortion. We conducted extensive experiments on both synthetic and real denoising datasets, validating the superiority of the proposed approach.

Restoring Vision in Adverse Weather Conditions With Patch-Based Denoising Diffusion Models

Denoising Adversarial Networks for Rain Removal and Reflection Removal.

Denoising as Adaptation: Noise-Space Domain Adaptation for Image Restoration

ReviveDiff: A Universal Diffusion Model for Restoring Images in Adverse Weather Conditions

Resfusion: Denoising Diffusion Probabilistic Models for Image Restoration Based on Prior Residual Noise

Restoration by Generation with Constrained Priors

A Unified Conditional Framework for Diffusion-based Image Restoration

Unsupervised Denoising of Retinal OCT with Diffusion Probabilistic Model

Joint Conditional Diffusion Model for Image Restoration with Mixed Degradations

Denoising Diffusion Models for Plug-and-Play Image Restoration

Image Restoration by Denoising Diffusion Models with Iteratively Preconditioned Guidance

Stimulating Diffusion Model for Image Denoising via Adaptive Embedding and Ensembling

Reconstruct-and-Generate Diffusion Model for Detail-Preserving Image Denoising

Refusion: Enabling Large-Size Realistic Image Restoration with Latent-Space Diffusion Models

Stimulating the Diffusion Model for Image Denoising Via Adaptive Embedding and Ensembling

Data-free Distillation with Degradation-prompt Diffusion for Multi-weather Image Restoration

ADIR: Adaptive Diffusion for Image Reconstruction

PD-CR: Patch-Based Diffusion Using Constrained Refinement for Image Restoration