Abstract:The existence of thick clouds covers the comprehensive Earth observation of optical remote sensing images (RSIs). Cloud removal is an effective and economical preprocessing step to improve the subsequent applications of RSIs. Deep learning (DL)-based methods have attracted much attention and achieved state-of-the-art results. However, most of these methods suffer from the following issues: 1) ignore the physical characteristics of RSIs; 2) require paired images with/without cloud or extra auxiliary images; and 3) demand the cloud mask. These issues might have limited the flexibility of existing networks. In this article, we propose a novel low-rank regularized self-supervised network (LRRSSN) that couples model-driven and data-driven methods to remove the thick cloud from multitemporal RSIs (MRSIs). First, motivated by the equal importance of image and cloud components as well as their intrinsic characteristics, we decompose the observed image into low-rank image and structural sparse cloud components. In this way, we obtain a model-driven thick cloud removal method where the spectral–temporal low-rank correlation of the image component and the spectral structural sparsity of the cloud component are effectively exploited. Second, to capture the complex nonlinear features of different scenarios, the data-driven self-supervised network that does not require external training datasets is designed to explore the deep prior of the image component. Third, the coupled model-driven and data-driven LRRSSN is optimized by an efficient half quadratic splitting (HQS) algorithm. Finally, without knowing the exact cloud mask, we estimate the cloud mask to preserve information in cloud-free areas as much as possible. Experiments conducted in synthetic and real-world scenarios demonstrate the effectiveness of the proposed approach.

A Low-Rank and Sparse Constrained Dark Channel Prior for Cloud Removal in Remote Sensing Image Sequence

A Novel Thin Cloud Removal Method Based on Multiscale Dark Channel Prior (MDCP)

A Coarse-to-Fine Framework for Cloud Removal in Remote Sensing Image Sequence

A New Sparse Collaborative Low-Rank Prior Knowledge Representation for Thick Cloud Removal in Remote Sensing Images

Cloud Removal for Single Visible Image Based on Modified Dark Channel Prior with Multiple Scale.

Thick Cloud Removal in Multitemporal Remote Sensing Images via Low-Rank Regularized Self-Supervised Network

Single image dehazing based on dark channel prior

A Unified Framework of Cloud Detection and Removal Based on Low-Rank and Group Sparse Regularizations for Multitemporal Multispectral Images

Deep Low-Rank Prior for Hyperspectral Anomaly Detection

Combined deep prior with low-rank tensor SVD for thick cloud removal in multitemporal images

Remote sensing image cloud removal by deep image prior with a multitemporal constraint

Spectral-Temporal Consistency Prior for Cloud Removal from Remote Sensing Images

Thick Cloud Removal in Multitemporal Remote Sensing Images Using a Coarse-to-Fine Framework

Two-Pass Robust Component Analysis for Cloud Removal in Satellite Image Sequence

Feature-Domain Fidelity and Tensor Low-Rank Regularization for Cloud Removal in Remote Sensing Images

Unsupervised Domain Factorization Network for Thick Cloud Removal of Multitemporal Remotely Sensed Images

An Innovative Approach for Effective Removal of Thin Clouds in Optical Images Using Convolutional Matting Model

A Lightweight Machine-Learning Method for Cloud Removal in Remote Sensing Images Constrained by Conditional Information

Removal of Optically Thick Clouds from High-Resolution Satellite Imagery Using Dictionary Group Learning and Interdictionary Nonlocal Joint Sparse Coding

Gated Convolutional Networks for Cloud Removal From Bi-Temporal Remote Sensing Images