Abstract:Despite recent advances, developing general-purpose universal denoising and artifact-removal networks remains largely an open problem: Given fixed network weights, one inherently trades-off specialization at one task (e.g.,~removing Poisson noise) for performance at another (e.g.,~removing speckle noise). In addition, training such a network is challenging due to the curse of dimensionality: As one increases the dimensions of the specification-space (i.e.,~the number of parameters needed to describe the noise distribution) the number of unique specifications one needs to train for grows exponentially. Uniformly sampling this space will result in a network that does well at very challenging problem specifications but poorly at easy problem specifications, where even large errors will have a small effect on the overall mean squared error. In this work we propose training denoising networks using an adaptive-sampling/active-learning strategy. Our work improves upon a recently proposed universal denoiser training strategy by extending these results to higher dimensions and by incorporating a polynomial approximation of the true specification-loss landscape. This approximation allows us to reduce training times by almost two orders of magnitude. We test our method on simulated joint Poisson-Gaussian-Speckle noise and demonstrate that with our proposed training strategy, a single blind, generalist denoiser network can achieve peak signal-to-noise ratios within a uniform bound of specialized denoiser networks across a large range of operating conditions. We also capture a small dataset of images with varying amounts of joint Poisson-Gaussian-Speckle noise and demonstrate that a universal denoiser trained using our adaptive-sampling strategy outperforms uniformly trained baselines.

Transfer Learning From Synthetic to Real-Noise Denoising With Adaptive Instance Normalization

Grouped Multi-Scale Network for Real-World Image Denoising.

Image denoising algorithm based on adversarial learning using joint loss function

Spatial-Adaptive Network for Single Image Denoising

Dynamic Residual Dense Network For Image Denoising

Enhancing and Learning Denoiser Without Clean Reference

Learning to Translate Noise for Robust Image Denoising

Dictionary Transfer for Image Denoising Via Domain Adaptation

Denoising as Adaptation: Noise-Space Domain Adaptation for Image Restoration

NoiseTransfer: Image Noise Generation with Contrastive Embeddings

Learning from Natural Noise to Denoise Micro-Doppler Spectrogram

Learning to Generate Realistic Noisy Images via Pixel-level Noise-aware Adversarial Training

Feature-Align Network with Knowledge Distillation for Efficient Denoising

Learning Model-Blind Temporal Denoisers without Ground Truths

NTGAN: Learning Blind Image Denoising Without Clean Reference.

Enhancing convolutional neural network generalizability via low-rank weight approximation

Multi-scale information fusion generative adversarial network for real-world noisy image denoising

A Scalable Training Strategy for Blind Multi-Distribution Noise Removal

Adaptive noise imitation for image denoising

An Unsupervised Deep Learning Approach for Real-World Image Denoising.