Abstract:Remote sensing images are very vulnerable to cloud interference during the imaging process. Cloud occlusion, especially thick cloud occlusion, significantly reduces the imaging quality of remote sensing images, which in turn affects a variety of subsequent tasks using the remote sensing images. The remote sensing images miss ground information due to thick cloud occlusion. The thick cloud removal method based on a temporality global–local structure is initially suggested as a solution to this problem. This method includes two stages: the global multi-temporal feature fusion (GMFF) stage and the local single-temporal information restoration (LSIR) stage. It adopts the fusion feature of global multi-temporal to restore the thick cloud occlusion information of local single temporal images. Then, the featured global–local structure is created in both two stages, fusing the global feature capture ability of Transformer with the local feature extraction ability of CNN, with the goal of effectively retaining the detailed information of the remote sensing images. Finally, the local feature extraction (LFE) module and global–local feature extraction (GLFE) module is designed according to the global–local characteristics, and the different module details are designed in this two stages. Experimental results indicate that the proposed method performs significantly better than the compared methods in the established data set for the task of multi-temporal thick cloud removal. In the four scenes, when compared to the best method CMSN, the peak signal-to-noise ratio (PSNR) index improved by 2.675, 5.2255, and 4.9823 dB in the first, second, and third temporal images, respectively. The average improvement of these three temporal images is 9.65%. In the first, second, and third temporal images, the correlation coefficient (CC) index improved by 0.016, 0.0658, and 0.0145, respectively, and the average improvement for the three temporal images is 3.35%. Structural similarity (SSIM) and root mean square (RMSE) are improved 0.33% and 34.29%, respectively. Consequently, in the field of multi-temporal cloud removal, the proposed method enhances the utilization of multi-temporal information and achieves better effectiveness of thick cloud restoration.

FDT-Net: Deep-Learning Network for Thin-Cloud Removal in Remote Sensing Image Using Frequency-Domain Training Strategy

Thin Cloud Removal for Multispectral Remote Sensing Images Using Convolutional Neural Networks Combined With an Imaging Model

A deep-learning reconstruction method for remote sensing images with large thick cloud cover

GLTF-Net: Deep-Learning Network for Thick Cloud Removal of Remote Sensing Images via Global–Local Temporality and Features

Wavelet Integrated Convolutional Neural Network for Thin Cloud Removal in Remote Sensing Images

Thick Clouds Removal From Multitemporal ZY-3 Satellite Images Using Deep Learning

MRF-Net: An Infrared Remote Sensing Image Thin Cloud Removal Method With the Intra-Inter Coherent Constraint

Thick Cloud Removal in Multitemporal Remote Sensing Images Using a Coarse-to-Fine Framework

Cloud Removal from Satellite Images Using a Deep Learning Model with the Cloud-Matting Method

An effective thin cloud removal procedure for visible remote sensing images

An Innovative Approach for Effective Removal of Thin Clouds in Optical Images Using Convolutional Matting Model

Multi-Stage Frequency Attention Network for Progressive Optical Remote Sensing Cloud Removal

Thin Cloud Removal Fusing Full Spectral and Spatial Features for Sentinel-2 Imagery

Denoising Diffusion Probabilistic Feature-Based Network for Cloud Removal in Sentinel-2 Imagery

A multitemporal remote sensing thick cloud removal network based on implicit reconstruction

Deep learning based cloud detection for medium and high resolution remote sensing images of different sensors

Remote Sensing Image Cloud Detection Using a Shallow Convolutional Neural Network

Cloud Detection in Remote Sensing Images Based on Multiscale Features-Convolutional Neural Network

Thick Cloud Removal in Multitemporal Remote Sensing Images via Low-Rank Regularized Self-Supervised Network