Abstract:Easy and efficient acquisition of high-resolution remote sensing images is of importance in geographic information systems. Previously, deep neural networks composed of convolutional layers have achieved impressive progress in super-resolution reconstruction. However, the inherent problems of the convolutional layer, including the difficulty of modeling the long-range dependency, limit the performance of these networks on super-resolution reconstruction. To address the abovementioned problems, we propose a generative adversarial network (GAN) by combining the advantages of the swin transformer and convolutional layers, called SWCGAN. It is different from the previous super-resolution models, which are composed of pure convolutional blocks. The essential idea behind the proposed method is to generate high-resolution images by a generator network with a hybrid of convolutional and swin transformer layers and then to use a pure swin transformer discriminator network for adversarial training. In the proposed method, first, we employ a convolutional layer for shallow feature extraction that can be adapted to flexible input sizes; second, we further propose the residual dense swin transformer block to extract deep features for upsampling to generate high-resolution images; and third, we use a simplified swin transformer as the discriminator for adversarial training. To evaluate the performance of the proposed method, we compare the proposed method with other state-of-the-art methods by utilizing the UCMerced benchmark dataset, and we apply the proposed method to real-world remote sensing images. The results demonstrate that the reconstruction performance of the proposed method outperforms other state-of-the-art methods in most metrics.

A Compact Memristor-based GAN Architecture with a Case Study on Single Image Super-Resolution

Hybrid Dual-Complementary Metal-Oxide-semiconductor/memristor Synapse-Based Neural Network with Its Applications in Image Super-Resolution

A Memristor based Unsupervised Neuromorphic System Towards Fast and Energy-Efficient GAN

Single Image Super-Resolution Via the Implementation of the Hardware-Friendly Sparse Coding

End-to-End Image Super-Resolution Via Generative Adversarial Network

Learning Structral Coherence Via Generative Adversarial Network for Single Image Super-Resolution

Generative Adversarial Network-based Image Super-Resolution with a Novel Quality Loss

MFAGAN: A Compression Framework for Memory-Efficient On-Device Super-Resolution GAN

Single Image Super Resolution Reconstruction Based on the Combination of Residual Encoding-Decoding Structure and GAN.

Image Super Resolution Reconstruction Algorithm Based on Generative Countermeasure Network

Gram-GAN: Image Super-Resolution Based on Gram Matrix and Discriminator Perceptual Loss

G-GANISR: Gradual generative adversarial network for image super resolution

A Residual Dense Attention Generative Adversarial Network for Microscopic Image Super-Resolution

A Super-Resolution Generative Adversarial Network with Simplified Gradient Penalty and Relativistic Discriminator

Multiscale generative adversarial network for real-world super-resolution

Single Image Super-Resolution Reconstruction of Enhanced Loss Function with Multi-GPU Training

A Positive-Unlabeled Generative Adversarial Network for Super-Resolution Image Reconstruction Using a Charbonnier Loss

SWCGAN: Generative Adversarial Network Combining Swin Transformer and CNN for Remote Sensing Image Super-Resolution

Single Image Super-Resolution Reconstruction based on the ResNeXt Network

Generative Adversarial Networks for Image Super-Resolution: A Survey

Multi-level Feature Extraction and Edge Reconstruction Fused Generative Adversarial Networks for Image Super Resolution