Abstract:Existing learning-based denoising methods typically train models to generalize the image prior from large-scale datasets, suffering from the variability in noise distributions encountered in real-world scenarios. In this work, we propose a new perspective on the denoising challenge by highlighting the distinct separation between noise and image priors. This insight forms the basis for our development of conditional optimization framework, designed to overcome the constraints of traditional denoising framework. To this end, we introduce a Locally Noise Prior Estimation (LoNPE) algorithm, which accurately estimates the noise prior directly from a single raw noisy image. This estimation acts as an explicit prior representation of the camera sensor's imaging environment, distinct from the image prior of scenes. Additionally, we design an auxiliary learnable LoNPE network tailored for practical application to sRGB noisy images. Leveraging the estimated noise prior, we present a novel Conditional Denoising Transformer (Condformer), by incorporating the noise prior into a conditional self-attention mechanism. This integration allows the Condformer to segment the optimization process into multiple explicit subspaces, significantly enhancing the model's generalization and flexibility. Extensive experimental evaluations on both synthetic and real-world datasets, demonstrate that the proposed method achieves superior performance over current state-of-the-art methods. The source code is available at <a class="link-external link-https" href="https://github.com/YuanfeiHuang/Condformer" rel="external noopener nofollow">this https URL</a>.

Image-Specific Prior Adaptation for Denoising

Spatial-Adaptive Network for Single Image Denoising

External Patch Prior Guided Internal Clustering for Image Denoising

Denoising Adversarial Networks for Rain Removal and Reflection Removal.

Learning Deep Image Priors for Blind Image Denoising

Deep Image Denoising with Adaptive Priors

Give me a hint: an explicit prior based image denoising

Image denoising using group sparsity residual and external nonlocal self-similarity prior

Beyond Image Prior: Embedding Noise Prior into Conditional Denoising Transformer

A deep image prior-based three-stage denoising method using generative and fusion strategies

Learning Deep CNN Denoiser Prior for Image Restoration

Group Sparsity Residual Constraint for Image Denoising with External Nonlocal Self-Similarity Prior

Self-Supervised Image Denoising Using Implicit Deep Denoiser Prior

Learning Multi‐Scale Deep Image Prior for High‐Quality Unsupervised Image Denoising

Group Sparsity Residual Constraint for Image Denoising.

Score Priors Guided Deep Variational Inference for Unsupervised Real-World Single Image Denoising

Linear Combinations of Patches are Unreasonably Effective for Single-Image Denoising

Content-Adaptive Low Rank Regularization For Image Denoising

Joint image denoising using adaptive principal component analysis and self-similarity

Stochastic Deep Restoration Priors for Imaging Inverse Problems