Abstract:Transformers have recently gained significant attention in low-level vision tasks, particularly for remote sensing image super-resolution (RSISR). The vanilla vision transformer aims to establish long-range dependencies between image patches. However, its global receptive field leads to a quadratic increase in computational complexity with respect to spatial size, rendering it inefficient for addressing RSISR tasks that involve processing large-sized images. In an effort to mitigate computational costs, recent studies have explored the utilization of local attention mechanisms, inspired by convolutional neural networks (CNNs), focusing on interactions between patches within small windows. Nevertheless, these approaches are naturally influenced by smaller participating receptive fields, and the utilization of fixed window sizes hinders their ability to perceive multi-scale information, consequently limiting model performance. To address these challenges, we propose a hierarchical transformer model named the Multi-Scale and Global Representation Enhancement-based Transformer (MSGFormer). We propose an efficient attention mechanism, Dual Window-based Self-Attention (DWSA), combining distributed and concentrated attention to balance computational complexity and the receptive field range. Additionally, we incorporated the Multi-scale Depth-wise Convolution Attention (MDCA) module, which is effective in capturing multi-scale features through multi-branch convolution. Furthermore, we developed a new Tracing-Back Structure (TBS), offering tracing-back mechanisms for both proposed attention modules to enhance their feature representation capability. Extensive experiments demonstrate that MSGFormer outperforms state-of-the-art methods on multiple public RSISR datasets by up to 0.11–0.55 dB.

Scale-Aware Backprojection Transformer for Single Remote Sensing Image Super-Resolution

Multi-granularity Backprojection Transformer for Remote Sensing Image Super-Resolution

CSwT-SR: Conv-Swin Transformer for Blind Remote Sensing Image Super-Resolution with Amplitude-Phase Learning and Structural Detail Alternating Learning

Cross-Spatial Pixel Integration and Cross-Stage Feature Fusion Based Transformer Network for Remote Sensing Image Super-Resolution

Parallel-Connected Residual Channel Attention Network for Remote Sensing Image Super-Resolution

Hybrid-Scale Hierarchical Transformer for Remote Sensing Image Super-Resolution

Activated Sparsely Sub-Pixel Transformer for Remote Sensing Image Super-Resolution

Single Remote Sensing Image Super-Resolution Via a Generative Adversarial Network with Stratified Dense Sampling and Chain Training

Enhanced Window-Based Self-Attention with Global and Multi-Scale Representations for Remote Sensing Image Super-Resolution

TTST: A Top-k Token Selective Transformer for Remote Sensing Image Super-Resolution

MSWAGAN: Multispectral Remote Sensing Image Super-Resolution Based on Multiscale Window Attention Transformer

Task-Aware Dynamic Transformer for Efficient Arbitrary-Scale Image Super-Resolution

Remote Sensing Image Super-Resolution Using Enriched Spatial-Channel Feature Aggregation Networks

Transformer-Based Dual-Branch Multiscale Fusion Network for Pan-Sharpening Remote Sensing Images

Single-image Super-Resolution Via Selective Multi-Scale Network

An Efficient Hybrid CNN-Transformer Approach for Remote Sensing Super-Resolution

Multi-Scale Implicit Transformer with Re-parameterize for Arbitrary-Scale Super-Resolution

Multi-scale Single Image Super-Resolution with Remote-Sensing Application Using Transferred Wide Residual Network

Two-Stage Spatial-Frequency Joint Learning for Large-Factor Remote Sensing Image Super-Resolution

A2M: an Amplification-Arbitrary Module for Remote Sensing Image Super-Resolution

PFT-SSR: Parallax Fusion Transformer for Stereo Image Super-Resolution