Global and Local Dual Fusion Network for Large-Ratio Cloud Occlusion Missing Information Reconstruction of a High-Resolution Remote Sensing Image
Weiling Liu,Yonghua Jiang,Jingyin Wang,Guo Zhang,Da Li,Huaibo Song,Yun Yang,Xiao Huang,Xinghua Li,Jun Yang
DOI: https://doi.org/10.1109/lgrs.2024.3356533
IF: 5.343
2024-02-23
IEEE Geoscience and Remote Sensing Letters
Abstract:Large-ratio cloud occlusion significantly hampers the utilization of high-resolution remote sensing imagery. The existing reconstruction methods 1) overlook the problem of reconstructed and composite images sharing high- and low-level semantic and visual attributes in nonreconstructed regions, exacerbating the pronounced boundary effects; 2) neglect appearance discrepancies between reconstructed and nonreconstructed regions, leading to spectral degradation, and texture loss; and 3) overlook the problem of reconstructing large-ratio missing information. To address these issues, a global and local dual fusion network (GLDF-RecNet) is proposed in this study for large-ratio cloud occlusion removal in high-resolution remote sensing images. The global foreground–background aware attention module tackles shared high-level semantic features, whereas the local visual feature enhancement (LVRE) module addresses appearance differences. The GLDF-RecNet combines the Sobel and reconstruction loss functions for effective reconstruction by employing a two-stage fusion strategy. Compared to the classical recurrent feature reasoning network, spatiotemporal generator network (STGAN), spatial–temporal–spectral convolutional neural network (STS-CNN), and bishift network (BSN), the proposed model demonstrates superior quantitative and visual reconstruction outcomes for the 40%, 50%, and 70% missing ratios of Gaofen-1 (2 m).
imaging science & photographic technology,remote sensing,engineering, electrical & electronic,geochemistry & geophysics