Abstract:Pixels of clouds and cloud shadows in a remote sensing image impact image quality, image interpretation, and subsequent applications. In this paper, we propose a novel cloud removal method based on deep learning that automatically reconstructs the invalid pixels with the auxiliary information from multi-temporal images. Our method’s innovation lies in its feature extraction and loss functions, which reside in a novel gated convolutional network (GCN) instead of a series of common convolutions. It takes the current cloudy image, a recent cloudless image, and the mask of clouds as input, without any requirements of external training samples, to realize a self-training process with clean pixels in the bi-temporal images as natural training samples. In our feature extraction, gated convolutional layers, for the first time, are introduced to discriminate cloudy pixels from clean pixels, which make up for a common convolution layer’s lack of the ability to discriminate. Our multi-level constrained joint loss function, which consists of an image-level loss, a feature-level loss, and a total variation loss, can achieve local and global consistency both in shallow and deep levels of features. The total variation loss is introduced into the deep-learning-based cloud removal task for the first time to eliminate the color and texture discontinuity around cloud outlines needing repair. On the WHU cloud dataset with diverse land cover scenes and different imaging conditions, our experimental results demonstrated that our method consistently reconstructed the cloud and cloud shadow pixels in various remote sensing images and outperformed several mainstream deep-learning-based methods and a conventional method for every indicator by a large margin.

Robust Haze and Thin Cloud Removal via Conditional Variational Autoencoders

From Coarse to Fine: A Two-Stage Network for Dense Haze removal

Robust Single Image Dehazing Based on Consistent and Contrast-Assisted Reconstruction

An Enhancement in Single-Image Dehazing Employing Contrastive Attention over Variational Auto-Encoder (CA-VAE) Method

Cloud-Aware Generative Network: Removing Cloud From Optical Remote Sensing Images

Visibility Restoration of Single Haze Images Based On Feature Aggregation

A Cascaded Convolutional Neural Network for Single Image Dehazing

Single image dehazing via cycle-consistent adversarial networks with a multi-scale hybrid encoder-decoder and global correlation loss

Image Dehazing Technique Based on DenseNet and the Denoising Self-Encoder

Single image mixed dehazing method based on numerical iterative model and DehazeNet

Robust Real-World Image Dehazing Via Knowledge Guided Conditional Diffusion Model Finetuning

Joint haze image synthesis and dehazing with mmd-vae losses

Progressive Feature Fusion Network for Realistic Image Dehazing

Restoring vision in hazy weather with hierarchical contrastive learning

Multiple Linear Regression Haze-removal Model Based on Dark Channel Prior

Gated Convolutional Networks for Cloud Removal From Bi-Temporal Remote Sensing Images

SEQUENTIALLY REFINED SPATIAL AND CHANNEL-WISE FEATURE AGGREGATION IN ENCODER-DECODER NETWORK FOR SINGLE IMAGE DEHAZING

Foggy Image Restoration Using Deep Sub‐pixel Reconstruction Network

Single image haze removal for aqueous vapour regions based on optimal correction of dark channel

SCL-Dehaze: Toward Real-World Image Dehazing via Semi-Supervised Codebook Learning