Abstract:Traditional supervised denoisers are trained using pairs of noisy input and clean target images. They learn to predict a central tendency of the posterior distribution over possible clean images. When, e.g., trained with the popular quadratic loss function, the network's output will correspond to the minimum mean square error (MMSE) estimate. Unsupervised denoisers based on Variational AutoEncoders (VAEs) have succeeded in achieving state-of-the-art results while requiring only unpaired noisy data as training input. In contrast to the traditional supervised approach, unsupervised denoisers do not directly produce a single prediction, such as the MMSE estimate, but allow us to draw samples from the posterior distribution of clean solutions corresponding to the noisy input. To approximate the MMSE estimate during inference, unsupervised methods have to create and draw a large number of samples - a computationally expensive process - rendering the approach inapplicable in many situations. Here, we present an alternative approach that trains a deterministic network alongside the VAE to directly predict a central tendency. Our method achieves results that surpass the results achieved by the unsupervised method at a fraction of the computational cost.

What problem does this paper attempt to address?

The problem that this paper attempts to solve is how to efficiently remove image noise in biomedical imaging without using paired clean images. Specifically, the author proposes a new method - Direct Denoiser, aiming to overcome two main problems in existing unsupervised denoising methods: 1. **High computational cost**: Traditional unsupervised denoising methods (such as those based on Variational Auto - Encoder (VAE)) need to approximate the Minimum Mean Square Error (MMSE) estimate or the Minimum Mean Absolute Error (MMAE) estimate through multiple samplings, which leads to a high computational cost. Especially when dealing with large - scale data sets, this high computational cost is unacceptable. 2. **Limited performance improvement**: Although existing unsupervised denoising methods have approached or even surpassed supervised methods in performance, they usually require a large amount of computational resources to generate high - quality denoising results. To address these problems, the author proposes a deterministic Convolutional Neural Network (CNN) jointly trained with VAE, called Direct Denoiser. This network can directly predict the MMSE or MMAE solution from the noisy image without the need for multiple samplings. This method not only significantly reduces the computational cost but also shows performance superior to existing unsupervised methods in experiments on multiple data sets. ### Main contributions 1. **Efficient single - inference**: The Direct Denoiser can generate high - quality denoising results in one forward propagation without the need for multiple samplings, thus greatly reducing the computational time. 2. **Superior performance**: The experimental results show that the Direct Denoiser has better Peak Signal - to - Noise Ratio (PSNR) performance on multiple data sets than existing unsupervised methods, especially when dealing with large - scale data sets. 3. **Flexible loss function**: The Direct Denoiser can predict different central tendencies (such as MMAE or MMSE) by choosing different loss functions (such as L1 or L2 loss), providing more flexibility. ### Method overview 1. **Joint training**: The Direct Denoiser is jointly trained with VAE. VAE is used to generate possible clean image samples, which serve as the training targets for the Direct Denoiser. 2. **Loss function**: The Direct Denoiser is trained using L1 or L2 loss functions to predict the pixel - level median (MMAE) or mean (MMSE) respectively. 3. **Inference process**: In the inference stage, the Direct Denoiser only needs one forward propagation to generate the denoising result without the need for multiple samplings. ### Experimental results The paper conducted experiments on multiple biomedical imaging data sets, including Convallaria, Confocal Mice, 2 - Photon Mice, Mouse Actin, Mouse Nuclei and Struct. Convallaria. The experimental results show that the Direct Denoiser significantly outperforms existing unsupervised methods in terms of PSNR and the inference time is greatly reduced. ### Conclusion The method proposed by the author is not only superior to existing unsupervised denoising methods in performance but also has a significant improvement in computational efficiency. This makes the Direct Denoiser an ideal choice for processing large - scale biomedical imaging data and is expected to become the standard method in the field of unsupervised denoising in the future.

Direct Unsupervised Denoising

Unsupervised Denoising for Signal-Dependent and Row-Correlated Imaging Noise

Fully Unsupervised Diversity Denoising with Convolutional Variational Autoencoders

Unsupervised Deep Video Denoising with Untrained Network

Deep Variation Prior: Joint Image Denoising and Noise Variance Estimation Without Clean Data

Self-Calibrated Variance-Stabilizing Transformations for Real-World Image Denoising

Noise2Variance: Dual networks with variance constraint for self‐supervised real‐world image denoising

Learning Model-Blind Temporal Denoisers without Ground Truths

$ε$-VAE: Denoising as Visual Decoding

Training Deep Learning Based Denoisers without Ground Truth Data

Neighbor2Neighbor: A Self-Supervised Framework for Deep Image Denoising

Variational Denoising Network: Toward Blind Noise Modeling and Removal

An Unsupervised Deep Learning Approach for Real-World Image Denoising.

Unsupervised Coordinate-Based Video Denoising

SeNM-VAE: Semi-Supervised Noise Modeling with Hierarchical Variational Autoencoder

Recorrupted-to-Recorrupted: Unsupervised Deep Learning for Image Denoising

Riesz-Quincunx-UNet Variational Auto-Encoder for Satellite Image Denoising

Score Priors Guided Deep Variational Inference for Unsupervised Real-World Single Image Denoising

Denoising Auto-Encoders Toward Robust Unsupervised Feature Representation.

Neighbor2Neighbor: Self-Supervised Denoising from Single Noisy Images

Self-supervised Image Denoising with Downsampled Invariance Loss and Conditional Blind-Spot Network