Abstract:Satellite optical images, upon their on-ground receipt, offer a distorted view of the observed scene. Their restoration, classically including denoising, deblurring, and sometimes super-resolution, is required before their exploitation. Moreover, quantifying the uncertainty related to this restoration could be valuable by lowering the risk of hallucination and avoiding propagating these biases in downstream applications. Deep learning methods are now state-of-the-art for satellite image restoration. However, they require to train a specific network for each sensor and they do not provide the associated uncertainties. This paper proposes a generic method involving a single network to restore images from several sensors and a scalable way to derive the uncertainties. We focus on deep regularization (DR) methods, which learn a deep prior on target images before plugging it into a model-based optimization scheme. First, we introduce VBLE-xz, which solves the inverse problem in the latent space of a variational compressive autoencoder, estimating the uncertainty jointly in the latent and in the image spaces. It enables scalable posterior sampling with relevant and calibrated uncertainties. Second, we propose the denoiser-based method SatDPIR, adapted from DPIR, which efficiently computes accurate point estimates. We conduct a comprehensive set of experiments on very high resolution simulated and real Pleiades images, asserting both the performance and robustness of the proposed methods. VBLE-xz and SatDPIR achieve state-of-the-art results compared to direct inversion methods. In particular, VBLE-xz is a scalable method to get realistic posterior samples and accurate uncertainties, while SatDPIR represents a compelling alternative to direct inversion methods when uncertainty quantification is not required.

Learning Satellite Image Recovery Through Turbulence

Remote Sensing Image Jitter Restoration Based on Deep Generative Adversarial Network

A Prior-Knowledge-Based Generative Adversarial Network for Unsupervised Satellite Cloud Image Restoration

Deep priors for satellite image restoration with accurate uncertainties

Improving Satellite Image Fusion Via Generative Adversarial Training

Compressive-Sensing Reconstruction for Satellite Monitor Data Using a Deep Generative Model

A Single Image Deep Learning Approach to Restoration of Corrupted Landsat-7 Satellite Images

Zero shot framework for satellite image restoration

Restoration of Turbulence-Degraded Images Using the Modified Convolutional Neural Network

Data--driven Image Restoration with Option--driven Learning for Big and Small Astronomical Image Datasets

Near-filed SAR Image Restoration with Deep Learning Inverse Technique: A Preliminary Study

A General Purpose Image Restoration Method with Deep Neural Network and Active Learning

Wide & deep learning for spatial & intensity adaptive image restoration

Modified ESRGAN with Uformer for Video Satellite Imagery Super-Resolution

Jitter Detection and Image Restoration Based on Generative Adversarial Networks in Satellite Images

Rapid Restoration of Turbulent Degraded Images Based on Bidirectional Multi-Scale Feature Fusion

Restoration of Ghost Imaging in Atmospheric Turbulence Based on Deep Learning

Learning Spatially Variant Degradation for Unsupervised Blind Photoacoustic Tomography Image Restoration

Data-driven Image Restoration with Option-Driven Learning for Big and Small Astronomical Image Data Sets

Convolutional Neural Processes for Inpainting Satellite Images

Learning deconvolutions for astronomical images