Abstract:In remote sensing image fusion, the conventional Convolutional Neural Networks (CNNs) extract local features of the image through layered convolution, which is limited by the receptive field and struggles to capture global features. Transformer utilizes self-attention to capture long-distance dependencies in images, which has a global receptive field, but the computational cost for high-resolution images is excessively high. In response to the above issues, this paper draws inspiration from the FusionNet network, harnessing the local detail acquisition capability of CNNs and the global data procuring capacity of Transformer. It presents a novel method for remote sensing image sharpening named Guided Filtering-Cross Stage Partial Network-Transformer, abbreviated as GF-CSTNet. This solution unifies the strengths of Guided Filtering (GF), Cross Stage Partial Network (CSPNet), and Transformer. Firstly, this method utilizes GF to enhance the acquired remote sensing image data. The CSPNet and Transformer structures are then combined to further enhance fusion performance by leveraging their respective advantages. Subsequently, a Rep-Conv2Former method is designed to streamline attention and extract diverse receptive field features through a multi-scale convolution modulator block. Simultaneously, a reparameterization module is constructed to integrate the multiple branches generated during training into a unified branch during inference, thereby optimizing the model's inference speed. Finally, a residual learning module incorporating attention has been devised to augment the modeling and feature extraction capabilities of images. Experimental results obtained from the GaoFen-2 and WorldView-3 datasets demonstrate the effectiveness of the proposed GF-CSTNet approach. It effectively extracts detailed information from images while avoiding the problem of spectral distortion.

Pansharpening with a Gradient Domain GIF Based on NSST

SSETPAN: Spatial-Spectral Enhanced Transformer Based Network for Pansharpening

Efficient and Accurate Hyperspectral Pansharpening Using 3D VolumeNet and 2.5D Texture Transfer

Pansharpening by Combining Enhanced Spatial-Spectral Fidelity and Gradient-Domain Guided Filtering

DuCoFPan: Dual-Condition Flow-based Network for Pan-sharpening

A pansharpening method combining iterative filtering and NSST-NSML-PAPCNN to optimize spatial detail extraction and injection

Detail Information Prior Net for Remote Sensing Image Pansharpening

Log-Gabor directional region entropy adaptive guided filtering for multispectral pansharpening

Pan-Sharpening via Multiscale Dynamic Convolutional Neural Network

UPanGAN: Unsupervised pansharpening based on the spectral and spatial loss constrained Generative Adversarial Network

Transformer-based dual path cross fusion for pansharpening remote sensing images

Pansharpening Based on Fuzzy Logic and Edge Activity

Attention-Guided Progressive Frequency-Decoupled Network for Pan-Sharpening

Multiscale Spatial-Frequency Domain Dynamic Pansharpening of Remote Sensing Images Integrated With Wavelet Transform

Spatial-Frequency Domain Information Integration for Pan-Sharpening

An IHS-Based Pan-Sharpening Method for Spectral Fidelity Improvement Using Ripplet Transform and Compressed Sensing

A novel pansharpening method based on cross stage partial network and transformer

PSMD-Net: A Novel Pan-Sharpening Method Based on a Multiscale Dense Network

Pan-GAN: An unsupervised pan-sharpening method for remote sensing image fusion

PAN-Guided Multiresolution Fusion Network Using Swin Transformer for Pansharpening

Domain-specific knowledge-driven pan-sharpening algorithm