Abstract:Super-resolution improves the spatial resolution of remote sensing images,providing detailed information for various satellite applications.However,existing methods often generate pseudo-detail and lose true detail in reconstructed images due to insufficient supervision images.To address this issue,a progressive super-resolution method based on multilevel supervision structure(MSSR)was proposed. First,the MSSR introduced ground truth images as guides,which reduced the loss of true detail and mitigated the appearance of pseudo-detail in an output image.The MSSR network consists of several basic super-resolution components(BSRCs)and multilevel supervision.The overall super-resolution scale factor of the MSSR network can be set flexibly.The BSRCs can be increased or decreased,similar to building blocks,and BSRCs decrease with decreasing overall super-resolution scale factor and increase with increasing overall super-resolution scale factor.The scale factor of each BSRC is determined by the overall scale factor and the number of BSRCs.Second,a scale-factor-adjustable and lightweight basic super-resolution component was designed to enable the construction of multilevel supervision networks with different number of BSRCs and different scale factors,such as building blocks.The BSRC consists of a multiscale feature extraction module,a global feature extraction module and an image reconstruction module.Given that the scale factor of each BSRC should have a degree of flexibility,the network structure of each BSRC is the same except for the image reconstruction module.This approach shortens the overall training time of the network.Finally,a method of dividing super-resolution overall scale factor was proposed,and the effects of different number and different scale factors of BSRCs on the performance of multilevel supervision network were explored.For the super-resolution process with a certain scale factor,we need a method to divide the overall scale factor into each BSRC.The number of supervision increases with the number of BSRCs,and the super-resolution ill-posedness is reduced.In addition,the total number of network layers and the number of computations increase.We determined the optimal number of BSRCs and their respective super-resolution scale factors by comparing the super-resolution effects of multiple BSRC combinations.Additionally,a new remote sensing dataset containing worldwide scenes was constructed for the super-resolution task in this paper. To adequately train and test the proposed super-resolution method and existing methods,we used our datasets and two existing super-resolution datasets:the UCMerced and AID datasets.We compared our method with the state-of-the-art methods:VDSR,SRGAN,RDN,RCAN,DRN,and TransENet.The experiment results on three datasets demonstrated that our MSSR network outperformed these methods. The progressive network and multilevel supervision structure can effectively suppress super-resolution ill-posedness and reduce pseudo-detail and detail loss in super-resolution results.By further analyzing the experimental results,we found that multilevel supervision has greater performance gains in super-resolution tasks with a larger scale factor than other methods.We speculated that the multilevel supervision network exhibit improved performance in super-resolution tasks at 4× magnification.In future research,we will explore multilevel supervision networks in super-resolution tasks at large magnifications(i.e.,5× and 8×).

Remote Sensing Image Super-Resolution Guided by Multi-Level Supervision Paradigm

A Prediction-to-Prediction Remote Sensing Image Super-Resolution Network under a Multi-Level Supervision Paradigm

Scene-Adaptive Remote Sensing Image Super-Resolution Using a Multiscale Attention Network

End-to-End Super-Resolution for Remote-Sensing Images Using an Improved Multi-Scale Residual Network

Multiscale Residual Dense Network for the Super-Resolution of Remote Sensing Images

Single Remote Sensing Image Super-Resolution Via a Generative Adversarial Network with Stratified Dense Sampling and Chain Training

A Remote Sensing Image Super-Resolution Reconstruction Model Combining Multiple Attention Mechanisms

Superresolution reconstruction of optical remote sensing images based on a multiscale attention adversarial network

Transferred Multi-Perception Attention Networks for Remote Sensing Image Super-Resolution.

Multi-Scale Residual Network For Image Super-Resolution

Multilevel Feature Exploration Network for Image Superresolution

Detail-Optimized Super-Resolution Reconstruction-Based Multistage Training Strategy for Remote Sensing Semantic Segmentation

A Super-Resolution Algorithm Based on Hybrid Network for Multi-Channel Remote Sensing Images

Dynamic Multi-Scale Network for Remote Sensing Image Super-Resolution

Remote Sensing Image Super-Resolution Via Dual-Resolution Network Based on Connected Attention Mechanism

Unpaired Remote Sensing Image Super-Resolution with Multi-Stage Aggregation Networks.

Single Image Super-Resolution Via Cascaded Multi-Scale Cross Network.

Super-Resolution Network for Remote Sensing Images Via Preclassification and Deep–Shallow Features Fusion

Progressive split-merge super resolution for hyperspectral imagery with group attention and gradient guidance

Remote Sensing Hyperspectral Image Super-Resolution via Multidomain Spatial Information and Multiscale Spectral Information Fusion

Remote Sensing Imagery Super Resolution Based on Adaptive Multi-Scale Feature Fusion Network