Abstract:The deep-learning-based image super-resolution opens a new direction for the remote sensing field to reconstruct further information and details from captured images. However, most current SR works try to improve the performance by increasing the complexity of the model, which results in significant computational costs and memory consumption. In this paper, we propose a lightweight model named pixel-wise attention residual network for optical remote sensor images, which can effectively solve the super-resolution task of multi-satellite images. The proposed method consists of three modules: the feature extraction module, feature fusion module, and feature mapping module. First, the feature extraction module is responsible for extracting the deep features from the input spatial bands with different spatial resolutions. Second, the feature fusion module with the pixel-wise attention mechanism generates weight coefficients for each pixel on the feature map and fully fuses the deep feature information. Third, the feature mapping module is aimed to maintain the fidelity of the spectrum by adding the fused residual feature map directly to the up-sampled low-resolution images. Compared with existing deep-learning-based methods, the major advantage of our method is that for the first time, the pixel-wise attention mechanism is incorporated in the task of super-resolution fusion of remote sensing images, which effectively improved the performance of the fusion network. The accuracy assessment results show that our method achieved superior performance of the root mean square error, signal-to–reconstruction ratio error, universal image quality index, and peak signal noise ratio compared to competing approaches. The improvements in the signal-to-reconstruction ratio error and peak signal noise ratio are significant, with a respective increase of 0.15 and 0.629 dB for Sentinel-2 data, and 0.196 and 1 dB for Landsat data.

Large Field Astronomical Image Restoration and Super-resolution Reconstruction Using Deep Learning

Deep Networks with Detail Enhancement for Infrared Image Super-Resolution

Orientation-Aware Deep Neural Network for Real Image Super-Resolution.

Cascaded Deep Networks with Multiple Receptive Fields for Infrared Image Super-Resolution

Learning deconvolutions for astronomical images

Endoscopic Image Deblurring and Super-Resolution Reconstruction Based on Deep Learning

Image Restoration with Point Spread Function Regularization and Active Learning

A General Purpose Image Restoration Method with Deep Neural Network and Active Learning

Data--driven Image Restoration with Option--driven Learning for Big and Small Astronomical Image Datasets

Satellite Image Super-Resolution Via Multi-Scale Residual Deep Neural Network

Astronomical Image Restoration and Point Spread Function Estimation with Deep Neural Networks

Obtaining Super-Resolution Satellites Images Based on Enhancement Deep Convolutional Neural Network

Remote Sensing Image Super-Resolution Using Novel Dense-Sampling Networks.

Image Super-Resolution Reconstruction Based on Sparse Representation and Deep Learning

A Multi-Scale Recursive Attention Feature Fusion Network for Image Super-Resolution Reconstruction Algorithm

Pixel-Wise Attention Residual Network for Super-Resolution of Optical Remote Sensing Images.

Deep Deconvolution Neural Network for Image Super-Resolution

Enhanced Attention-Based Back Projection Network for Image Super-Resolution in Sensor Network

Remote Sensing Images Super-Resolution with Deep Convolution Networks

Multi-Receptive-Fields Convolutional Network for Remote Sensing Images Super-Resolution

RFCNet: Remote Sensing Image Super-Resolution Using Residual Feature Calibration Network