Abstract:Single-Image super resolution(SISR) of remote sensing images aims to improve image resolution through algorithmic means while restoring rich high-frequency detailed information. Previously, convolutional neural network(CNN) achieves impressive progress in SISR due to its strong local feature extraction capability. However, CNN is difficult to model long-range dependencies, which limits the performance of SISR. Transformer has a greater advantage over CNN in long-range dependency modeling. Moreover, remote sensing elements typically exhibit multi-scale characteristics and maintain strong coupling relationships with the surrounding environment. Paying attention to multi-scale local and global information can help further improve the performance of SISR. Existing methods encounter challenges in leveraging diverse feature sets within single architecture networks. In this paper, we propose a multi-scale CNN-Transformer feature fusion(MSCT) network for remote sensing SISR. MSCT is a hybrid structural network, which consists of the adaptive residual dense block(ARDB), the multi-scale Transformer block(MSTB) and the local-global information enhancement block(LGEB). Among them, ARDB can extract abundant multi-scale local features via dense connected convolutional layers and adaptive residual learning. MSTB generates multi-scale tokens with multiple convolutional layers to obtain multi-scale global information. LGEB further enhance the extraction of local-global information in spatial and frequency domain. Extensive experiments on multiple datasets show that MSCT achieves competitive results on RGB remote sensing imagery compared with other representative SISR methods. In addition, SR experiments on Sentinel-2 images show that MSCT has a certain generalization ability on multispectral images. Extended experiments also demonstrate that MSCT can effectively improve the performance of object detection. The code and data are available at https://github.com/yaoxudong241/MSCT .

Remote Sensing Image Super-Resolution with Top-K Token Selective Transformer

TTST: A Top-k Token Selective Transformer for Remote Sensing Image Super-Resolution

CSwT-SR: Conv-Swin Transformer for Blind Remote Sensing Image Super-Resolution with Amplitude-Phase Learning and Structural Detail Alternating Learning

Cross-Spatial Pixel Integration and Cross-Stage Feature Fusion Based Transformer Network for Remote Sensing Image Super-Resolution

Remote Sensing Image Super-Resolution Via Cross-Scale Hierarchical Transformer

Rethinking Transformers for Semantic Segmentation of Remote Sensing Images.

Activated Sparsely Sub-Pixel Transformer for Remote Sensing Image Super-Resolution

Transcending the Limit of Local Window: Advanced Super-Resolution Transformer with Adaptive Token Dictionary

T3SR: Texture Transfer Transformer for Remote Sensing Image Superresolution

Enhanced Window-Based Self-Attention with Global and Multi-Scale Representations for Remote Sensing Image Super-Resolution

Remote Sensing Image Super-Resolution Using Enriched Spatial-Channel Feature Aggregation Networks

An Efficient Hybrid CNN-Transformer Approach for Remote Sensing Super-Resolution

Transformer-Based Multistage Enhancement for Remote Sensing Image Super-Resolution

Remote Sensing Scene Classification via Second-Order Differentiable Token Transformer Network

Hybrid-Scale Hierarchical Transformer for Remote Sensing Image Super-Resolution

A Lightweight Distillation CNN-transformer Architecture for Remote Sensing Image Super-Resolution

AdaFormer: Efficient Transformer with Adaptive Token Sparsification for Image Super-resolution

Enhancing Multiscale Representations with Transformer for Remote Sensing Image Semantic Segmentation

Single-Image Super Resolution for RGB Remote Sensing Imagery Via Multi-Scale CNN-Transformer Feature Fusion

Multi-granularity Backprojection Transformer for Remote Sensing Image Super-Resolution

SVTSR: Image Super-Resolution Using Scattering Vision Transformer