Abstract:This paper finds that simple loss design focusing on variance can train a plain convolutional neural network denoiser in a self‐supervised manner. The trained convolutional neural network denoiser method has relatively good performance among existing self‐supervised denoising methods in real world image denoising. Image denoising aims to restore a clean image from a noisy image. Traditional methods utilizing convolutional neural networks (CNN) for denoising are trained using pairs of noisy and clean images to comprehend the transformation from a noisy image to a clean one. However, the acquisition of such image pairs in real‐world scenarios presents a challenge. Hence, numerous self‐supervised denoising techniques have been developed that do not require clean images for training. This study demonstrates that a straightforward loss design, concentrating on variance, can effectively train a standard CNN denoiser in a self‐supervised fashion. A novel theoretical framework is introduced for training a basic CNN denoising model using three constraints: mean, variance, and augmentation. The variance constraint is crucial as it prevents the trained model from converging to trivial solutions such as identity or zero mapping. This theory provides valuable insights for the development of new self‐supervised denoising methods. Furthermore, a method that applies this theory to proposed dual networks is developed, which consist of two standard CNN models predicting both the clean image and the noise. This approach enhances model capacity during training while minimizing computational costs during inference. This method exemplifies the implementation of the variance constraint and introduces a data constraint for dual networks. Notably, the proposed method only assumes the presence of additive white noise, irrespective of the noise distribution. This minimal assumption enhances the model's robustness against noise with complex or unknown distributions in real‐world distorted images. Experimental results indicate that the proposed Noise2Variance method exhibits commendable performance on peak signal noise ratio and structural similarity metrics compared to existing self‐supervised denoising techniques. Visual comparison of results further substantiates the efficacy of the proposed method. A comparison of model complexity reveals that the method is efficient among the compared CNN‐based techniques.

Deep Variance Network: an Iterative, Improved CNN Framework for Unbalanced Training Datasets.

Deep Vanishing Component Analysis Network for Pattern Classification

Deep Variational Multivariate Information Bottleneck -- A Framework for Variational Losses

Optimization Variance: Exploring Generalization Properties of DNNs

Spatial-Temporal-Fusion BNN: Variational Bayesian Feature Layer

Learning a Deep Structural Subspace Across Hyperspectral Scenes with Cross-Domain VAE

Deep CovDenseSNN: A Hierarchical Event-Driven Dynamic Framework with Spiking Neurons in Noisy Environment

Hierarchical Deep Neural Network for Multivariate Regression

Subdomain contraction in deep networks for robust representation learning

Deep Variational Metric Learning

CovNN: A Covariance Neural Network Extended from CNN

Deep Variational Network Embedding in Wasserstein Space

VAE-based Deep SVDD for anomaly detection

Deep Over-sampling Framework for Classifying Imbalanced Data

Noise2Variance: Dual networks with variance constraint for self‐supervised real‐world image denoising

Total Variability Modelling for Face Representation Learning with CNN Multi-Layers

Learning CNN on ViT: A Hybrid Model to Explicitly Class-specific Boundaries for Domain Adaptation

Deep Asymmetric Transfer Network For Unbalanced Domain Adaptation

Class-Imbalanced Deep Learning via a Class-Balanced Ensemble

Variance Suppression: Balanced Training Process in Deep Learning

Training Bayesian Neural Networks with Sparse Subspace Variational Inference