Abstract:Single-Image super resolution(SISR) of remote sensing images aims to improve image resolution through algorithmic means while restoring rich high-frequency detailed information. Previously, convolutional neural network(CNN) achieves impressive progress in SISR due to its strong local feature extraction capability. However, CNN is difficult to model long-range dependencies, which limits the performance of SISR. Transformer has a greater advantage over CNN in long-range dependency modeling. Moreover, remote sensing elements typically exhibit multi-scale characteristics and maintain strong coupling relationships with the surrounding environment. Paying attention to multi-scale local and global information can help further improve the performance of SISR. Existing methods encounter challenges in leveraging diverse feature sets within single architecture networks. In this paper, we propose a multi-scale CNN-Transformer feature fusion(MSCT) network for remote sensing SISR. MSCT is a hybrid structural network, which consists of the adaptive residual dense block(ARDB), the multi-scale Transformer block(MSTB) and the local-global information enhancement block(LGEB). Among them, ARDB can extract abundant multi-scale local features via dense connected convolutional layers and adaptive residual learning. MSTB generates multi-scale tokens with multiple convolutional layers to obtain multi-scale global information. LGEB further enhance the extraction of local-global information in spatial and frequency domain. Extensive experiments on multiple datasets show that MSCT achieves competitive results on RGB remote sensing imagery compared with other representative SISR methods. In addition, SR experiments on Sentinel-2 images show that MSCT has a certain generalization ability on multispectral images. Extended experiments also demonstrate that MSCT can effectively improve the performance of object detection. The code and data are available at https://github.com/yaoxudong241/MSCT .

Remote Sensing Image Super-Resolution Using Enriched Spatial-Channel Feature Aggregation Networks

Parallel-Connected Residual Channel Attention Network for Remote Sensing Image Super-Resolution

Efficient Adaptive Feature Fusion Network for Remote-Sensing Image Super-Resolution

Hyperspectral Image Super-Resolution Via Convolutional Neural Network

Single-Image Superresolution for RGB Remote Sensing Imagery via Multiscale CNN-Transformer Feature Fusion

Single-Image Super Resolution for RGB Remote Sensing Imagery Via Multi-Scale CNN-Transformer Feature Fusion

Spatial and Channel Aggregation Network for Lightweight Image Super-Resolution

Single-image Super-Resolution Via Selective Multi-Scale Network

RFCNet: Remote Sensing Image Super-Resolution Using Residual Feature Calibration Network

Cross-Spatial Pixel Integration and Cross-Stage Feature Fusion Based Transformer Network for Remote Sensing Image Super-Resolution

An Efficient Hybrid CNN-Transformer Approach for Remote Sensing Super-Resolution

Remote Sensing Image Super-Resolution Based on Dense Channel Attention Network

Remote Sensing Image Super-Resolution Using Novel Dense-Sampling Networks.

Remote Sensing Image Super-Resolution Via Dual-Resolution Network Based on Connected Attention Mechanism

Non-Locally up-Down Convolutional Attention Network for Remote Sensing Image Super-Resolution

Wider Channel Attention Network for Remote Sensing Image Super-resolution

Multi-Receptive-Fields Convolutional Network for Remote Sensing Images Super-Resolution

Image Super-Resolution Via Deep Aggregation Network

Transformer-Based Multistage Enhancement for Remote Sensing Image Super-Resolution

A Lightweight Distillation CNN-transformer Architecture for Remote Sensing Image Super-Resolution

Super-resolution for Remote Sensing Images Via Dual-Domain Network Learning.