Abstract:Image super-resolution (SR) techniques improve various remote sensing applications by allowing for finer spatial details than those captured by the original acquisition sensors. Recent advances in deep learning bring a new opportunity for SR by learning the mapping from low to high resolution. The most used convolutional neural networks (CNN) based approaches are prone to excessive smoothing or blurring due to the optimization objective in mean squared error (MSE). Instead, generative adversarial network (GAN) based approaches can achieve more perceptually acceptable results. However, the preliminary design of GANs generator with simple direct- or skip-connection residual blocks compromises its SR potential. Emerging dense convolutional network (DenseNet) equipped with dense connections has shown a promising prospect in classification and super-resolution. An intuitive idea to introduce DenseNet into GAN is expected to boost SR performance. However, because convolutional kernels in the existing residual block are arranged into a one-dimensional flat structure, the formation of dense connections highly relies on skip connections (linking the current layer to all subsequent layers with a shortcut path). In order to increase connection density, the depth of the layer has to be accordingly expanded, which in turn results in training difficulties such as vanishing gradient and information propagation loss. To this end, this paper proposes an ultra-dense GAN (udGAN) for image SR, where we reform the internal layout of the residual block into a two-dimensional matrix topology. This topology can provide additional diagonal connections so that we can still accomplish enough pathways with fewer layers. In particular, the pathways are almost doubled compared to previous dense connections under the same number of layers. The achievable rich connections are flexibly adapted to the diversity of image content, thus leading to improved SR performance. Extensive experiments on public benchmark datasets and real-world satellite imagery show that our model outperforms state-of-the-art counterparts in both subjective and quantitative assessments, especially those related to perception.

Generative Adversarial Image Super-Resolution Through Deep Dense Skip Connections.

End-to-End Image Super-Resolution Via Generative Adversarial Network

Learning Structral Coherence Via Generative Adversarial Network for Single Image Super-Resolution

Single Remote Sensing Image Super-Resolution Via a Generative Adversarial Network with Stratified Dense Sampling and Chain Training

Generative Adversarial Network-based Image Super-Resolution with a Novel Quality Loss

Ultra-dense GAN for Satellite Imagery Super-Resolution.

Super-Resolution of Remote Sensing Images via a Dense Residual Generative Adversarial Network

Learning Spectral and Spatial Features Based on Generative Adversarial Network for Hyperspectral Image Super-Resolution

Hyperspectral Imagery Spatial Super-Resolution Using Generative Adversarial Network.

Image Super-Resolution Reconstruction Using Generative Adversarial Networks Based on Wide-Channel Activation

A Residual Dense Attention Generative Adversarial Network for Microscopic Image Super-Resolution

Image Super-Resolution Using a Improved Generative Adversarial Network

Image Super-Resolution Reconstruction Based on a Generative Adversarial Network

Sharp And Real Image Super-Resolution Using Generative Adversarial Network

A Super-Resolution Generative Adversarial Network with Simplified Gradient Penalty and Relativistic Discriminator

Image Super‐resolution Based on Self‐similarity Generative Adversarial Networks

Hyperspectral Image Super-Resolution Using Generative Adversarial Network And Residual Learning

SRPGAN: Perceptual Generative Adversarial Network for Single Image Super Resolution.

Hierarchical Generative Adversarial Networks for Single Image Super-Resolution

Single Frame Image Super-Resolution Reconstruction Based on Improved Generative Adversarial Network

Generative Adversarial Network-Based Super-Resolution Considering Quantitative And Perceptual Quality