Unsupervised Degradation Aware and Representation for Real-World Remote Sensing Image Super-Resolution

Wen-Zhong Guo,Wu-Ding Weng,Guang-Yong Chen,Jian-Nan Su,Min Gan,C. L. Philip Chen

DOI: https://doi.org/10.1109/tgrs.2024.3407844

IF: 8.2

2024-01-01

IEEE Transactions on Geoscience and Remote Sensing

Abstract:Blind super-resolution (BlindSR) has recently attracted attention in the field of remote sensing. Due to the lack of paired data, most works assume that the acquired remote sensing images are high-resolution (HR) and use predefined degradation models to synthesize low-resolution (LR) images for training and evaluation. However, these acquired remote sensing images are often degraded by various factors, which still require super-resolution reconstruction to meet practical needs. Using them as ground truth images will limit the model’s ability to restore fine details, resulting in blurry and noisy reconstructions. To overcome these limitations, we propose an unsupervised degradation-aware network which transforms natural images into the degraded domain as real-world remote sensing images. It uses natural images containing rich texture information as a reference for fine-grained restoration of the network, enabling the network to produce clearer reconstructions. Furthermore, we discovered the remarkable capability of patch-wise discriminator to perceive the degradation type of different regions within the acquired remote sensing image. Inspired by this finding, we design a novel degradation representation module (DRM) that can estimate the degradation information from LR images and guide the network to perform adaptive restoration. Comprehensive experimental results demonstrate that our proposed unsupervised blind super-resolution framework (UDASR) achieves state-of-the-art restoration performance. Our code and pre-trained models have been uploaded to GitHub† for validation.