Abstract:Single-Image super resolution(SISR) of remote sensing images aims to improve image resolution through algorithmic means while restoring rich high-frequency detailed information. Previously, convolutional neural network(CNN) achieves impressive progress in SISR due to its strong local feature extraction capability. However, CNN is difficult to model long-range dependencies, which limits the performance of SISR. Transformer has a greater advantage over CNN in long-range dependency modeling. Moreover, remote sensing elements typically exhibit multi-scale characteristics and maintain strong coupling relationships with the surrounding environment. Paying attention to multi-scale local and global information can help further improve the performance of SISR. Existing methods encounter challenges in leveraging diverse feature sets within single architecture networks. In this paper, we propose a multi-scale CNN-Transformer feature fusion(MSCT) network for remote sensing SISR. MSCT is a hybrid structural network, which consists of the adaptive residual dense block(ARDB), the multi-scale Transformer block(MSTB) and the local-global information enhancement block(LGEB). Among them, ARDB can extract abundant multi-scale local features via dense connected convolutional layers and adaptive residual learning. MSTB generates multi-scale tokens with multiple convolutional layers to obtain multi-scale global information. LGEB further enhance the extraction of local-global information in spatial and frequency domain. Extensive experiments on multiple datasets show that MSCT achieves competitive results on RGB remote sensing imagery compared with other representative SISR methods. In addition, SR experiments on Sentinel-2 images show that MSCT has a certain generalization ability on multispectral images. Extended experiments also demonstrate that MSCT can effectively improve the performance of object detection. The code and data are available at https://github.com/yaoxudong241/MSCT .

Dynamic Multi-Scale Network for Remote Sensing Image Super-Resolution

Single Remote Sensing Image Super-Resolution Via a Generative Adversarial Network with Stratified Dense Sampling and Chain Training

Single-Image Super Resolution for RGB Remote Sensing Imagery Via Multi-Scale CNN-Transformer Feature Fusion

Multiscale Residual Dense Network for the Super-Resolution of Remote Sensing Images

Single-image Super-Resolution Via Selective Multi-Scale Network

Multi-scale Single Image Super-Resolution with Remote-Sensing Application Using Transferred Wide Residual Network

Scene-Adaptive Remote Sensing Image Super-Resolution Using a Multiscale Attention Network

Single Image Super-Resolution Using Asynchronous Multi-Scale Network

Single-Image Superresolution for RGB Remote Sensing Imagery via Multiscale CNN-Transformer Feature Fusion

Non-linear Perceptual Multi-Scale Network for Single Image Super-Resolution

The Multi-scale Fast Network for Image Super-resolution

A New Super Resolution Framework Based on Multi-Task Learning for Remote Sensing Images

Remote Sensing Image Super-Resolution Using Novel Dense-Sampling Networks.

Multi-Receptive-Fields Convolutional Network for Remote Sensing Images Super-Resolution

A Lightweight Multi-Scale Channel Attention Network for Image Super-Resolution.

Multi-Scale Deep Neural Networks for Real Image Super-Resolution

End-to-End Super-Resolution for Remote-Sensing Images Using an Improved Multi-Scale Residual Network

Remote Sensing Image Super-Resolution Using Enriched Spatial-Channel Feature Aggregation Networks

Satellite Image Super-Resolution Via Multi-Scale Residual Deep Neural Network

Multi-Scale Residual Network For Image Super-Resolution

Remote Sensing Image Super-Resolution Using Second-Order Multi-Scale Networks