Abstract:The super-resolution algorithms based on deep learning can effectively increase optical remote sensing image (ORSI) details for further analysis tasks. Deep unfolding methods have been studied in recent years to bridge the gap between optimization-based and learning-based methods. However, these unfolding methods usually ignore the utilization of intermediate network features between different iteration stages, thereby limiting the performance of super-resolution results. We propose a multi-source information fusion network (MSFNet) for ORSI super-resolution to address this problem. We mainly consider three strategies to enhance the image super-resolution performance, including feature extraction strategy, information fusion strategy, and the structure of the unfolding network. Firstly, image information of various scales is helpful for mining potential features of images for image super-resolution. Therefore, we introduce multi-scale implicit constraints to the objective function. Secondly, we unfold the optimization process into a neural network by alternating direction method of multipliers (ADMM). This unfolding strategy can effectively utilize the prior information for image reconstruction. Thirdly, we propose a row-column decoupling Transformer module for feature fusion. Specifically, the row Transformer block completes the feature fusion of various scales, and the column Transformer block completes the feature fusion of various channels. The fused features are transmitted to the next iteration stage for feature enhancement. We perform experiments on three remote sensing image datasets to fully demonstrate the algorithm's effectiveness. Experiment results show that the proposed algorithm can achieve better image reconstruction performance.

Single image super-resolution with multi-scale information cross-fusion network

Multi-Scale Cross-Attention Fusion Network Based on Image Super-Resolution

Single Image Super-Resolution Via Cascaded Multi-Scale Cross Network.

Compressed Multi-Scale Feature Fusion Network for Single Image Super-Resolution.

Multi-Scale Residual Network For Image Super-Resolution

An Image Super-Resolution Network Based on Multi-Scale Convolution Fusion

Image Super-Resolution Via Multi-View Information Fusion Networks.

Single-image Super-Resolution Via Selective Multi-Scale Network

A Multi-Scale Recursive Attention Feature Fusion Network for Image Super-Resolution Reconstruction Algorithm

Multi-Source Deep Residual Fusion Network for Depth Image Super-resolution

MFFN: image super-resolution via multi-level features fusion network

Image Super-Resolution Via a Novel Cascaded Convolutional Neural Network Framework.

Channel-Wise and Spatial Feature Modulation Network for Single Image Super-Resolution

Single Image Super-Resolution Based On Multi-Scale Competitive Convolutional Neural Network

Multi-scale feature aggregation network for Image super-resolution

Single Image Super Resolution Via Multi-Attention Fusion Recurrent Network.

Multisource Information Fusion Network for Optical Remote Sensing Image Super-Resolution.

Multi-scale attention network for image super-resolution

A deep recursive multi-scale feature fusion network for image super-resolution?

A channel-wise multi-scale network for single image super-resolution

Remote Sensing Imagery Super Resolution Based on Adaptive Multi-Scale Feature Fusion Network