Abstract:In remote sensing images (RSIs), the visual characteristics of different regions are versatile, which poses a considerable challenge to single image super-resolution (SISR). Most existing SISR methods for RSIs ignore the diverse reconstruction needs of different regions and thus face a serious contradiction between high perception quality and less spatial distortion. The mean square error (MSE) optimization-based methods produce results of unsatisfactory visual quality, while generative adversarial networks (GANs) can produce photo-realistic but severely distorted results caused by pseudotextures. In addition, increasingly deeper networks, although providing powerful feature representations, also face problems of overfitting and occupying too much storage space. In this article, we propose a new saliency-guided feedback GAN (SG-FBGAN) to address these problems. The proposed SG-FBGAN applies different reconstruction principles for areas with varying levels of saliency and uses feedback (FB) connections to improve the expressivity of the network while reducing parameters. First, we propose a saliency-guided FB generator with our carefully designed paired-feedback block (PFBB). The PFBB uses two branches, a salient and a nonsalient branch, to handle the FB information and generate powerful high-level representations for salient and nonsalient areas, respectively. Then, we measure the visual perception quality of salient areas, nonsalient areas, and the global image with a saliency-guided multidiscriminator, which can dramatically eliminate pseudotextures. Finally, we introduce a curriculum learning strategy to enable the proposed SG-FBGAN to handle complex degradation models. Comprehensive evaluations and ablation studies validate the effectiveness of our proposal.

GAN-Based Image Super-Resolution with a Novel Quality Loss

Infrared Image Super Resolution Using Gan With Infrared Image Prior

Adaptive Loss Function for Super Resolution Neural Networks Using Convex Optimization Techniques

Generative Adversarial Networks for Image Super-Resolution: A Survey

Single image super-resolution using Wasserstein generative adversarial network with gradient penalty

Gram-GAN: Image Super-Resolution Based on Gram Matrix and Discriminator Perceptual Loss

Efficient Super Resolution For Large-Scale Images Using Attentional GAN

Deep Objective Quality Assessment Driven Single Image Super-Resolution

Remote Sensing Image Super-Resolution via Saliency-Guided Feedback GANs

SRPGAN: Perceptual Generative Adversarial Network for Single Image Super Resolution.

G-GANISR: Gradual generative adversarial network for image super resolution

Single image super-resolution with denoising diffusion GANS

SD-GAN: Saliency-Discriminated GAN for Remote Sensing Image Superresolution

Details or Artifacts: A Locally Discriminative Learning Approach to Realistic Image Super-Resolution

Single image super-resolution via Image Quality Assessment-Guided Deep Learning Network

A Super-Resolution Generative Adversarial Network with Simplified Gradient Penalty and Relativistic Discriminator

Single Remote Sensing Image Super-Resolution Via a Generative Adversarial Network with Stratified Dense Sampling and Chain Training

Single Image Super-Resolution Reconstruction of Enhanced Loss Function with Multi-GPU Training

Super-Resolution of Remote Sensing Images via a Dense Residual Generative Adversarial Network

SRWGANTV: Image Super-Resolution Through Wasserstein Generative Adversarial Networks with Total Variational Regularization

Improved Residual Dense Network for Large Scale Super-Resolution via Generative Adversarial Network