Abstract:Image super-resolution (SR) techniques improve various remote sensing applications by allowing for finer spatial details than those captured by the original acquisition sensors. Recent advances in deep learning bring a new opportunity for SR by learning the mapping from low to high resolution. The most used convolutional neural networks (CNN) based approaches are prone to excessive smoothing or blurring due to the optimization objective in mean squared error (MSE). Instead, generative adversarial network (GAN) based approaches can achieve more perceptually acceptable results. However, the preliminary design of GANs generator with simple direct- or skip-connection residual blocks compromises its SR potential. Emerging dense convolutional network (DenseNet) equipped with dense connections has shown a promising prospect in classification and super-resolution. An intuitive idea to introduce DenseNet into GAN is expected to boost SR performance. However, because convolutional kernels in the existing residual block are arranged into a one-dimensional flat structure, the formation of dense connections highly relies on skip connections (linking the current layer to all subsequent layers with a shortcut path). In order to increase connection density, the depth of the layer has to be accordingly expanded, which in turn results in training difficulties such as vanishing gradient and information propagation loss. To this end, this paper proposes an ultra-dense GAN (udGAN) for image SR, where we reform the internal layout of the residual block into a two-dimensional matrix topology. This topology can provide additional diagonal connections so that we can still accomplish enough pathways with fewer layers. In particular, the pathways are almost doubled compared to previous dense connections under the same number of layers. The achievable rich connections are flexibly adapted to the diversity of image content, thus leading to improved SR performance. Extensive experiments on public benchmark datasets and real-world satellite imagery show that our model outperforms state-of-the-art counterparts in both subjective and quantitative assessments, especially those related to perception.

A Novel Quadruple Generative Adversarial Network for Semi-Supervised Categorization of Low-Resolution Images

Generative Adversarial Network-based Image Super-Resolution with a Novel Quality Loss

Increasingly Specialized Generative Adversarial Network for Fine-Grained Visual Categorization.

Single Remote Sensing Image Super-Resolution Via a Generative Adversarial Network with Stratified Dense Sampling and Chain Training

Learning Structral Coherence Via Generative Adversarial Network for Single Image Super-Resolution

A Positive-Unlabeled Generative Adversarial Network for Super-Resolution Image Reconstruction Using a Charbonnier Loss

End-to-End Image Super-Resolution Via Generative Adversarial Network

A Novel Multi-Loss-Based Deep Adversarial Network For Handling Challenging Cases In Semi-Supervised Image Semantic Segmentation

Super Resolution Generative Adversarial Network Based Image Augmentation for Scene Classification of Remote Sensing Images

Triple Generative Adversarial Networks.

Super-resolved Image Perceptual Quality Improvement Via Multifeature Discriminators

Real-World Image Super Resolution via Unsupervised Bi-directional Cycle Domain Transfer Learning based Generative Adversarial Network

Semi-Supervised Fine-Grained Image Categorization Using Transfer Learning with Hierarchical Multi-Scale Adversarial Networks

Generative Adversarial Image Super-Resolution Through Deep Dense Skip Connections.

Coupled Adversarial Training for Remote Sensing Image Super-Resolution

Semisupervised Multiscale Generative Adversarial Network for Semantic Segmentation of Remote Sensing Image.

Ultra-dense GAN for Satellite Imagery Super-Resolution.

Local-Global Context-Aware Generative Dual-Region Adversarial Networks for Remote Sensing Scene Image Super-Resolution

G-GANISR: Gradual generative adversarial network for image super resolution

DRL-GAN: Dual-Stream Representation Learning GAN for Low-Resolution Image Classification in UAV Applications

Gram-GAN: Image Super-Resolution Based on Gram Matrix and Discriminator Perceptual Loss