Abstract:Remote sensing images usually contain abundant targets and complex information distributions. Consequently, networks are required to model both global and local information in the super-resolution (SR) reconstruction of remote sensing images. The existing SR reconstruction algorithms generally focus on only local or global features, neglecting effective feedback for reconstruction errors. Therefore, a Global Residual Multi-attention Fusion Back-projection Network (SRBPSwin) is introduced by combining the back-projection mechanism with the Swin Transformer. We incorporate a concatenated Channel and Spatial Attention Block (CSAB) into the Swin Transformer Block (STB) to design a Multi-attention Hybrid Swin Transformer Block (MAHSTB). SRBPSwin develops dense back-projection units to provide bidirectional feedback for reconstruction errors, enhancing the network's feature extraction capabilities and improving reconstruction performance. SRBPSwin consists of the following four main stages: shallow feature extraction, shallow feature refinement, dense back projection, and image reconstruction. Firstly, for the input low-resolution (LR) image, shallow features are extracted and refined through the shallow feature extraction and shallow feature refinement stages. Secondly, multiple up-projection and down-projection units are designed to alternately process features between high-resolution (HR) and LR spaces, obtaining more accurate and detailed feature representations. Finally, global residual connections are utilized to transfer shallow features during the image reconstruction stage. We propose a perceptual loss function based on the Swin Transformer to enhance the detail of the reconstructed image. Extensive experiments demonstrate the significant reconstruction advantages of SRBPSwin in quantitative evaluation and visual quality.

A Swin Transformer-Based Fusion Approach for Hyperspectral Image Super-Resolution

CSwT-SR: Conv-Swin Transformer for Blind Remote Sensing Image Super-Resolution with Amplitude-Phase Learning and Structural Detail Alternating Learning

Dual Self-Attention Swin Transformer for Hyperspectral Image Super-Resolution

Fusformer: A Transformer-based Fusion Approach for Hyperspectral Image Super-resolution

HMFT: Hyperspectral and Multispectral Image Fusion Super-Resolution Method Based on Efficient Transformer and Spatial-Spectral Attention Mechanism

Image Super-resolution Reconstruction Network based on Enhanced Swin Transformer via Alternating Aggregation of Local-Global Features

Spectral-Enhanced Sparse Transformer Network for Hyperspectral Super-Resolution Reconstruction

Hyperspectral Image Super-resolution via Deep Spatio-spectral Convolutional Neural Networks

Information-Growth Swin Transformer Network for Image Super-Resolution.

FCSwinU: Fourier Convolutions and Swin Transformer UNet for Hyperspectral and Multispectral Image Fusion

Hyperspectral Image Super-Resolution via Deep Spatiospectral Attention Convolutional Neural Networks

Residual SwinV2 transformer coordinate attention network for image super resolution

HST: Hierarchical Swin Transformer for Compressed Image Super-resolution

SWUNet: Swin Transformer Based UNet for Hyperspectral Reconstruction

Spectral Swin Transformer Network for Hyperspectral Image Classification

An Efficient Hybrid CNN-Transformer Approach for Remote Sensing Super-Resolution

Hyperspectral Image Super-resolution via Knowledge-Driven Deep Unrolling and Transformer Embedded Convolutional Recurrent Neural Network

Hyperspectral and multispectral images fusion based on pyramid swin transformer

Fusformer: A Transformer-Based Fusion Network for Hyperspectral Image Super-Resolution

Hyperspectral and multispectral remote sensing image fusion using SwinGAN with joint adaptive spatial-spectral gradient loss function

SRBPSwin: Single-Image Super-Resolution for Remote Sensing Images Using a Global Residual Multi-Attention Hybrid Back-Projection Network Based on the Swin Transformer