Abstract:The increasing availability of sensors enables the combination of a high-spatial-resolution panchromatic image and a low-spatial-resolution multispectral image, which has become a hotspot in recent years for many applications. To address the spectral and spatial distortions that adversely affect the conventional methods, a pan-sharpening method based on a convolutional neural network (CNN) architecture is proposed in this paper, where the low-spatial-resolution multispectral image is upgraded and integrated with the high-spatial-resolution panchromatic image to produce a new multispectral image with high spatial resolution. Based on the pyramid structure of the CNN architecture, the proposed method has high learning capacity to generate more representative and robust hierarchical features for construction tasks. Moreover, the highly nonlinear fusion process can be effectively simulated by stacking several linear filtering layers, which is suitable for learning the complex mapping relationship between a high-spatial-resolution panchromatic and low-spatial-resolution multispectral image. Both qualitative and quantitative experimental analyses were carried out on images captured from a Landsat 8 on-board operational land imager (LOI) sensor to demonstrate the method's performance. The results regarding the sensitivity analysis of the involved parameters indicate the effects of parameters on the performance of our CNN-based pan-sharpening approach. Additionally, our CNN-based pan-sharpening approach outperforms other existing conventional pan-sharpening methods with a more promising fusion result for different landcovers, with differences in Erreur Relative Globale Adimensionnelle de Synthse (ERGAS), root-mean-squared error (RMSE), and spectral angle mapper (SAM) of 0.69, 0.0021, and 0.81 on average, respectively.

ESAFormer: Multi-resolution Fusion Network for Pansharpening

SSETPAN: Spatial-Spectral Enhanced Transformer Based Network for Pansharpening

Efficient and Accurate Hyperspectral Pansharpening Using 3D VolumeNet and 2.5D Texture Transfer

DuCoFPan: Dual-Condition Flow-based Network for Pan-sharpening

Spatial and Spectral Extraction Network With Adaptive Feature Fusion for Pansharpening

Transformer-based dual path cross fusion for pansharpening remote sensing images

Transformer-Based Dual-Branch Multiscale Fusion Network for Pan-Sharpening Remote Sensing Images

Detail Information Prior Net for Remote Sensing Image Pansharpening

Asymmetric Bidirectional Fusion Network for Remote Sensing Pansharpening

PanFormer: a Transformer Based Model for Pan-sharpening

Local-Global Based High-Resolution Spatial-Spectral Representation Network for Pansharpening

Remote Sensing Image Fusion Based on Two-stream Fusion Network

Pansharpening via Frequency-Aware Fusion Network With Explicit Similarity Constraints

A Cnn-Based Pan-Sharpening Method For Integrating Panchromatic And Multispectral Images Using Landsat 8

Convolutional Neural Network for Pansharpening with Spatial Structure Enhancement Operator

Convolutional LSTM-Based Hierarchical Feature Fusion for Multispectral Pan-Sharpening

STCP: Synergistic Transformer and Convolutional Neural Network for Pansharpening

SSCAConv: Self-Guided Spatial-Channel Adaptive Convolution for Image Fusion

A Multi-Stage Progressive Pansharpening Network Based on Detail Injection with Redundancy Reduction

MDSCNN: Remote Sensing Image Spatial–Spectral Fusion Method via Multi-Scale Dual-Stream Convolutional Neural Network