Abstract:Images acquired by optical remote sensing often suffer from noise, due to low-light conditions and long distances from the object. Noise introduces undesirable effects such as artifacts, unrealistic edges, unseen lines and corners, blurred objects and disturbed background scenes, and decreasing the performance of visual and computational analysis. The great majority of denoising methods only focus on single noise type, and mostly assume additive Gaussian white noise. However, in practice, according to the different sources of noise during the capturing process, the real image noise may be composed of noises from several different distributions, i.e., Poisson distribution from shot noise and dark current, Gaussian distribution from readout noise, etc. Thus, it is hard to model complex noise with a single noise model, which therefore limits the practical performance of image denoiser for real captured images. To address this problem, we propose a deep residual network with parameter estimation to model and remove mixed noises of remote sensing data, with no noise type and noise level information. In this chapter, a deep convolutional neural network based framework is proposed to implement both noise estimation and noise removing. The framework is composed of noise estimator module and denoiser module. The noise estimator module is used to estimate the noise distribution characteristics of the input image, which are used to synthesize the noisy dataset for the training of the denoiser module. After training, the denoiser module can then denoise the input image specifically for that noise characteristic of the input image. Besides, we use some advanced designment to improve the performance of the network like residual learning, skip connections, and perceptual loss. Our model works for both given noise types and others without taking into account in training process, and for the latter case we test the model on the noise mixed with different types, i.e., shot noise, Gaussian noise, salt and pepper noise, speckle noise, dark current, and quantization noise, covering most of the common noise types in practical situation. The estimated noise distribution according to the proposed estimator is compared with the ground truth to validate the performance of the estimator. We also compare the proposed method with the existing denoising methods, including both the traditional algorithm (i.e., BM3D (Dabov et al , IEEE Trans Image Process 16:2080-2095, 2007)) and the deep neural network (i.e., DnCNN (Zhang et al., IEEE Trans Image Process 26:3142-3155, 2017)). Experimental results showed that our method outperforms these state-of-the-art methods in both PSNR (peak signal to noise ratio) and SSIM (structural similarity index).

Self-Augmented Noisy Image for Noise2Noise Image Denoising

Self2Self+: Single-Image Denoising with Self-Supervised Learning and Image Quality Assessment Loss

Self-Supervised Denoising of single OCT image with Self2Self-OCT Network

Neighbor2Neighbor: Self-Supervised Denoising from Single Noisy Images

Positive2Negative: Breaking the Information-Lossy Barrier in Self-Supervised Single Image Denoising

Learning to Generate Realistic Noisy Images via Pixel-level Noise-aware Adversarial Training

Dual strategy for single image denoising and generation using deep neural network

Noisy-as-Clean: Learning Self-Supervised Denoising From Corrupted Image

Neighbor2Neighbor: A Self-Supervised Framework for Deep Image Denoising

Noise2Same: Optimizing A Self-Supervised Bound for Image Denoising

Neighboring Slice Noise2Noise: Self-Supervised Medical Image Denoising from Single Noisy Image Volume

Self-Supervised Self2Self Denoising Strategy Foroct Speckle Reduction with a Single Noisy Image

A Self-Supervised Hyperspectral Image Restoration Method Based on Convolutional Sparse Coding and Superpixel Segmentation

Self-supervised Bayesian Deep Learning for Image Denoising

Self2self With Dropout: Learning Self-Supervised Denoising From Single Image

Self-Supervised Learning based CT Denoising using Pseudo-CT Image Pairs

Remote Sensing Image Mixed Noise Denoising with Noise Parameter Estimation

Self-Calibrated Variance-Stabilizing Transformations for Real-World Image Denoising

Noise2Score: Tweedie's Approach to Self-Supervised Image Denoising without Clean Images

Noise2Kernel: Adaptive Self-Supervised Blind Denoising using a Dilated Convolutional Kernel Architecture

STN: Stochastic Triplet Neighboring Approach to Self-supervised Denoising from Limited Noisy Images