Abstract:Remote-sensing images (RSIs) generally have strong spatial characteristics for surface features. Various ground objects, such as residential areas, roads, forests, and rivers, differ substantially. According to this visual attention characteristic, regions with complicated texture features require more realistic details to reflect a better description of the topography, while regions such as farmlands should be smooth and have less noise. However, most existing single-image superresolution (SISR) methods fail to fully utilize these properties and therefore apply a uniform reconstruction strategy to the whole image. In this article, we propose a novel saliency-driven unequal single-image reconstruction network in which the demands of various regions in the superresolution (SR) process are distinguished by saliency maps. First, we design a new gradient-based saliency analysis method to produce more accurate saliency maps with imagewise annotations. The method utilizes the superiority of a multireception field to extract both high-level features and low-level features. Second, we propose a novel saliency-driven gate conditional generative adversarial network, where the saliency map is regarded as a medium during the training procedure of the whole network. The saliency map is regarded as a pixelwise condition in a generator to enhance the training capability of the network. Additionally, we design a new loss function that combines normalized content loss, saliency-driven perceptual loss, and gate-control adversarial loss to further refine details of texture-complex areas for RSIs. We evaluate the performance of our algorithm and compare it with many other state-of-the-art SR methods using a remote-sensing data set. The experimental results show that our approach achieves the optimal outcome in salient areas. Our method attains the best effect on global quality and visual performance.

Sparse representation based super resolution using saliency and edge information

Image super resolution using saliency-modulated context-aware sparse decomposition

Image Super Resolution Based on Salient Sparse Coding

A Sparse Representation Based Super-Resolution Image Reconstruction Scheme Utilizing Dual Dictionaries

Image super-resolution via sparse representation.

Double Sparse Dictionary Learning for Image Super Resolution

Image Super-Resolution Via Nonlocal Similarity and Group Structured Sparse Representation

A self-learning image super-resolution method via sparse representation and non-local similarity

Saliency adaptive super-resolution image reconstruction

Super-resolution image reconstruction method using analysis sparse representation

A Single-Image Super-Resolution Method Based on Progressive-Iterative Approximation

Image Super-Resolution Based on Structure-Modulated Sparse Representation.

Noisy Image Super-Resolution Reconstruction Based on Sparse Representation

Single Image Super-Resolution Using Incoherent Sub-Dictionaries Learning

Single Image Super-Resolution Using Sparse Prior

Image Super-Resolution by Structural Sparse Coding

Remote-Sensing Image Superresolution Based on Visual Saliency Analysis and Unequal Reconstruction Networks

Super resolution of single depth image based on multi-dictionary learning with edge feature regularization

Edge-Preserving Single Remote-Sensing Image Super-resolution Using Sparse Representations

Single-Image Super-Resolution by Subdictionary Coding and Kernel Regression

Image Super-Resolution Via Dual-Dictionary Learning And Sparse Representation