Abstract:Pansharpening belongs to an important part in the field of remote sensing image fusion, which refers to the fusion of low spatial resolution multispectral (MS) images with high spatial resolution (PAN) images to finally obtain high resolution multispectral (HRMS) images. The existing deep learning-based pan-sharpening methods have achieved better results compared with the traditional methods, but there are still two problems: spectral distortion and loss of spatial detail information. We propose an end-to-end attention-based dual-residual multi-stage remote sensing image fusion network (ADRPN) for MS image and PAN image pan-sharpening based on an in-depth study of spectral information of MS images and spatial information fusion of PAN images, which consists of three main stages, each resembling an encoder-decoder, and cross-stage fusion to achieve channel domain feature stitching. The first two stages are the feature extraction stage, where the features of MS images and PAN images are extracted using the residual module, and the different features learned are used to guide the training of individual networks using CRFB (Cross residual feature block). In the third stage (image reconstruction), we use the CA (Coordinate attention) and SE (Squeeze-and-Excitation) attention mechanism to enable the network to more precisely locate the region of interest by the precise location information obtained, which allows the features extracted in the first two stages to be better fused with the original image, thus reducing the occurrence of spectral distortion and loss of spatial detail information. Qualitative and quantitative analyses of real and simulated data from the benchmark datasets QuickBird (QB), GF-2, and WorldView-2 (WV2) show that the method can better preserve the spectral and spatial detail information and obtain high-quality HRMS images.

Convolutional LSTM-Based Hierarchical Feature Fusion for Multispectral Pan-Sharpening

SSETPAN: Spatial-Spectral Enhanced Transformer Based Network for Pansharpening

Efficient and Accurate Hyperspectral Pansharpening Using 3D VolumeNet and 2.5D Texture Transfer

Multispectral Pan-sharpening via Dual-Channel Convolutional Network with Convolutional LSTM Based Hierarchical Spatial-Spectral Feature Fusion

MESSFN : a Multi-level and Enhanced Spectral-Spatial Fusion Network for Pan-sharpening

Heterogeneous Two-Stream Network with Hierarchical Feature Prefusion for Multispectral Pan-Sharpening

Multispectral Pansharpening Based on Multisequence Convolutional Recurrent Neural Network

Going Deeper with Densely Connected Convolutional Neural Networks for Multispectral Pansharpening

Multi-Scale Bilateral Attention Fusion Network for Pansharpening

A Two-Stream Multiscale Deep Learning Architecture for Pan-Sharpening

Pan-Sharpening Based on Multilevel Coupled Deep Network

Multi-Frequency Spectral–Spatial Interactive Enhancement Fusion Network for Pan-Sharpening

Multimodal Sensors Image Fusion for Higher Resolution Remote Sensing Pan Sharpening

Attention-based dual residual network-based for multi-spectral pan-sharpening

Transformer-Based Dual-Branch Multiscale Fusion Network for Pan-Sharpening Remote Sensing Images

Multi-level features fusion via cross-layer guided attention for hyperspectral pansharpening

Feature Pyramid Fusion Network for Hyperspectral Pansharpening.

MFITN: A Multilevel Feature Interaction Transformer Network for Pansharpening

Real-time and effective pan-sharpening for remote sensing using multi-scale fusion network

Pansharpening Based on Multimodal Texture Correction and Adaptive Edge Detail Fusion

Learning High-frequency Feature Enhancement and Alignment for Pan-sharpening