Abstract:The deep convolutional neural network (DCNN) has recently been applied to the highly challenging and ill-posed problem of single image super-resolution (SISR), which aims to predict high-resolution (HR) images from their corresponding low-resolution (LR) images. In many remote sensing (RS) applications, spatial resolution of the aerial or satellite imagery has a great impact on the accuracy and reliability of information extracted from the images. In this study, the potential of a DCNN-based SISR model, called enhanced super-resolution generative adversarial network (ESRGAN), to predict the spatial information degraded or lost in a hyper-spatial resolution unmanned aircraft system (UAS) RGB image set is investigated. ESRGAN model is trained over a limited number of original HR (50 out of 450 total images) and virtually-generated LR UAS images by downsampling the original HR images using a bicubic kernel with a factor × 4 . Quantitative and qualitative assessments of super-resolved images using standard image quality measures (IQMs) confirm that the DCNN-based SISR approach can be successfully applied on LR UAS imagery for spatial resolution enhancement. The performance of DCNN-based SISR approach for the UAS image set closely approximates performances reported on standard SISR image sets with mean peak signal-to-noise ratio (PSNR) and structural similarity (SSIM) index values of around 28 dB and 0.85 dB, respectively. Furthermore, by exploiting the rigorous Structure-from-Motion (SfM) photogrammetry procedure, an accurate task-based IQM for evaluating the quality of the super-resolved images is carried out. Results verify that the interior and exterior imaging geometry, which are extremely important for extracting highly accurate spatial information from UAS imagery in photogrammetric applications, can be accurately retrieved from a super-resolved image set. The number of corresponding keypoints and dense points generated from the SfM photogrammetry process are about 6 and 17 times more than those extracted from the corresponding LR image set, respectively.

Structured Deep Unfolding Network for Optical Remote Sensing Image Super-Resolution

Untrained Neural Network Enabling Fast and Universal Structured-Illumination Microscopy

Deep Networks with Detail Enhancement for Infrared Image Super-Resolution

NoUCSR: Efficient Super-Resolution Network Without Upsampling Convolution.

Video Super-Resolution Based on Multiple Networks Merging

SR-USRN: Learning Image Super-Resolution with Unified Structure and Reverse Network.

Accurate and Lightweight Image Super-Resolution with Model-Guided Deep Unfolding Network

Single Remote Sensing Image Super-Resolution Via a Generative Adversarial Network with Stratified Dense Sampling and Chain Training

Orientation-Aware Deep Neural Network for Real Image Super-Resolution.

Cascaded Deep Networks with Multiple Receptive Fields for Infrared Image Super-Resolution

DEEP NEURAL NETWORKS FOR IMAGE SUPER-RESOLUTION IN OPTICAL MICROSCOPY BY USING MODIFIED HYBRID TASK CASCADE U-NET

Multi-scale Single Image Super-Resolution with Remote-Sensing Application Using Transferred Wide Residual Network

High Quality Remote Sensing Image Super-Resolution Using Deep Memory Connected Network

Long-Range Imaging through Scattering Media Using Deep Learning

Multimodal Deep Unfolding for Guided Image Super-Resolution

IESRGAN: Enhanced U-Net Structured Generative Adversarial Network for Remote Sensing Image Super-Resolution Reconstruction

A Deep Unfolding Network Based on Intrinsic Image Decomposition for Pansharpening

MGDUN: an Interpretable Network for Multi-Contrast MRI Image Super-Resolution Reconstruction

Deep Learning-Based Single Image Super-Resolution: An Investigation for Dense Scene Reconstruction with UAS Photogrammetry

A Deep Multitask Convolutional Neural Network for Remote Sensing Image Super-Resolution and Colorization

Non-Locally up-Down Convolutional Attention Network for Remote Sensing Image Super-Resolution