Dual-Resolution Local Attention Unfolding Network for Optical Remote Sensing Image Super-Resolution

Mengyang Shi,Yesheng Gao,Lin Chen,Xingzhao Liu
DOI: https://doi.org/10.1109/lgrs.2022.3224041
IF: 5.343
2022-01-01
IEEE Geoscience and Remote Sensing Letters
Abstract:Single-image super-resolution (SR) technology based on deep learning is widely applied in remote sensing. In recent years, the deep unfolding SR strategy has been proposed, which combines the neural networks with the traditional optimization-based algorithms, making the neural networks interpretable and achieving high performance. However, the typical deep unfolding algorithms usually treat different kinds of blurring kernels in the same way, so the algorithms cannot take advantage of the properties of blurring kernels, limiting the algorithm's performance. To design an SR network that can fully use the properties of the Gaussian blurring kernels, a dual-resolution local attention unfolding network (DLANet) is proposed. Based on the Gaussian blurring functions, a low-resolution (LR) space branch is designed to supplement the high-resolution (HR) space branch. Specifically, for the Gaussian blurring kernels, the closer the pixel is to the center, the greater the weight is. It means that the pixel points retained after downsampling will contain more information about the original corresponding pixel points, and it could be easier to estimate their original pixel values. So we design two branches. The HR branch completes the estimation of the whole image, and the LR branch only estimates the points retained after downsampling. To better complete the feature fusion of the two branches, we propose a row-column decoupling local attention module. This module can retain more information when fuse features and the row-column decoupling strategy can reduce the computational complexity. Comprehensive experiments demonstrate the superiority of our method over the current state-of-the-art on remote sensing datasets.
What problem does this paper attempt to address?