Abstract:Pansharpening belongs to an important part in the field of remote sensing image fusion, which refers to the fusion of low spatial resolution multispectral (MS) images with high spatial resolution (PAN) images to finally obtain high resolution multispectral (HRMS) images. The existing deep learning-based pan-sharpening methods have achieved better results compared with the traditional methods, but there are still two problems: spectral distortion and loss of spatial detail information. We propose an end-to-end attention-based dual-residual multi-stage remote sensing image fusion network (ADRPN) for MS image and PAN image pan-sharpening based on an in-depth study of spectral information of MS images and spatial information fusion of PAN images, which consists of three main stages, each resembling an encoder-decoder, and cross-stage fusion to achieve channel domain feature stitching. The first two stages are the feature extraction stage, where the features of MS images and PAN images are extracted using the residual module, and the different features learned are used to guide the training of individual networks using CRFB (Cross residual feature block). In the third stage (image reconstruction), we use the CA (Coordinate attention) and SE (Squeeze-and-Excitation) attention mechanism to enable the network to more precisely locate the region of interest by the precise location information obtained, which allows the features extracted in the first two stages to be better fused with the original image, thus reducing the occurrence of spectral distortion and loss of spatial detail information. Qualitative and quantitative analyses of real and simulated data from the benchmark datasets QuickBird (QB), GF-2, and WorldView-2 (WV2) show that the method can better preserve the spectral and spatial detail information and obtain high-quality HRMS images.

Dual-branch and triple-attention network for pan-sharpening

DuCoFPan: Dual-Condition Flow-based Network for Pan-sharpening

SSETPAN: Spatial-Spectral Enhanced Transformer Based Network for Pansharpening

Efficient and Accurate Hyperspectral Pansharpening Using 3D VolumeNet and 2.5D Texture Transfer

Attention-based dual residual network-based for multi-spectral pan-sharpening

A Triple-Double Convolutional Neural Network for Panchromatic Sharpening

Pansharpening Via Triplet Attention Network with Information Interaction

Transformer-Based Dual-Branch Multiscale Fusion Network for Pan-Sharpening Remote Sensing Images

Multispectral Pan-sharpening via Dual-Channel Convolutional Network with Convolutional LSTM Based Hierarchical Spatial-Spectral Feature Fusion

A Dual-Branch Detail Extraction Network for Hyperspectral Pansharpening

DiTBN: Detail Injection-Based Two-Branch Network for Pansharpening of Remote Sensing Images

Pan-Sharpening Based On Parallel Pyramid Convolutional Neural Network

Transformer-based dual path cross fusion for pansharpening remote sensing images

Multiscale Dual-Domain Guidance Network for Pan-Sharpening

Multi-Scale Bilateral Attention Fusion Network for Pansharpening

Spatial-Spectral Dual Back-Projection Network for Pansharpening

Pansharpening Based on Multi-Branch CNN

DADR: Dual Attention Based Dual Regression Network for Remote Sensing Image Pan-Sharpening

Pan-sharpening Method Based on Unsupervised and Divide-and-conquer Strategies

Spatial and Spectral Extraction Network With Adaptive Feature Fusion for Pansharpening

Rethinking Pan-Sharpening Via Spectral-Band Modulation