Abstract:Pansharpening belongs to an important part in the field of remote sensing image fusion, which refers to the fusion of low spatial resolution multispectral (MS) images with high spatial resolution (PAN) images to finally obtain high resolution multispectral (HRMS) images. The existing deep learning-based pan-sharpening methods have achieved better results compared with the traditional methods, but there are still two problems: spectral distortion and loss of spatial detail information. We propose an end-to-end attention-based dual-residual multi-stage remote sensing image fusion network (ADRPN) for MS image and PAN image pan-sharpening based on an in-depth study of spectral information of MS images and spatial information fusion of PAN images, which consists of three main stages, each resembling an encoder-decoder, and cross-stage fusion to achieve channel domain feature stitching. The first two stages are the feature extraction stage, where the features of MS images and PAN images are extracted using the residual module, and the different features learned are used to guide the training of individual networks using CRFB (Cross residual feature block). In the third stage (image reconstruction), we use the CA (Coordinate attention) and SE (Squeeze-and-Excitation) attention mechanism to enable the network to more precisely locate the region of interest by the precise location information obtained, which allows the features extracted in the first two stages to be better fused with the original image, thus reducing the occurrence of spectral distortion and loss of spatial detail information. Qualitative and quantitative analyses of real and simulated data from the benchmark datasets QuickBird (QB), GF-2, and WorldView-2 (WV2) show that the method can better preserve the spectral and spatial detail information and obtain high-quality HRMS images.

Boosting the Accuracy of Multispectral Image Pansharpening by Learning a Deep Residual Network

Efficient and Accurate Hyperspectral Pansharpening Using 3D VolumeNet and 2.5D Texture Transfer

Deep Residual Learning for Remote Sensed Imagery Pansharpening

Hyperspectral and Multispectral Image Fusion Based on Deep Attention Network.

Deep Residual Learning for Boosting the Accuracy of Hyperspectral Pansharpening.

Going Deeper with Densely Connected Convolutional Neural Networks for Multispectral Pansharpening

MSDRN: Pansharpening of Multispectral Images Via Multi-Scale Deep Residual Network.

A Multiscale and Multidepth Convolutional Neural Network for Remote Sensing Imagery Pan-Sharpening.

Supervised-unsupervised Combined Deep Convolutional Neural Networks for High-Fidelity Pansharpening

Detail-Injection-Based Multiscale Asymmetric Residual Network for Pansharpening

Attention-based dual residual network-based for multi-spectral pan-sharpening

An Efficient Pansharpening Approach Based on Spatial Information and Multi-Layer Fusion.

Detail Injection-Based Deep Convolutional Neural Networks for Pansharpening

PAN-Guided Multiresolution Fusion Network Using Swin Transformer for Pansharpening

Spatial-Spectral Fusion by Combining Deep Learning and Variation Model

Hyperspectral Pansharpening Based On Guided Filter And Deep Residual Learning

A New Pan-Sharpening Method With Deep Neural Networks

Coarse-to-Fine Cross-Domain Learning Fusion Network for Pansharpening.

A Triple-Double Convolutional Neural Network for Panchromatic Sharpening

Convolutional LSTM-Based Hierarchical Feature Fusion for Multispectral Pan-Sharpening

Pan-Sharpening Based on Multilevel Coupled Deep Network