Abstract:The increasing availability of sensors enables the combination of a high-spatial-resolution panchromatic image and a low-spatial-resolution multispectral image, which has become a hotspot in recent years for many applications. To address the spectral and spatial distortions that adversely affect the conventional methods, a pan-sharpening method based on a convolutional neural network (CNN) architecture is proposed in this paper, where the low-spatial-resolution multispectral image is upgraded and integrated with the high-spatial-resolution panchromatic image to produce a new multispectral image with high spatial resolution. Based on the pyramid structure of the CNN architecture, the proposed method has high learning capacity to generate more representative and robust hierarchical features for construction tasks. Moreover, the highly nonlinear fusion process can be effectively simulated by stacking several linear filtering layers, which is suitable for learning the complex mapping relationship between a high-spatial-resolution panchromatic and low-spatial-resolution multispectral image. Both qualitative and quantitative experimental analyses were carried out on images captured from a Landsat 8 on-board operational land imager (LOI) sensor to demonstrate the method's performance. The results regarding the sensitivity analysis of the involved parameters indicate the effects of parameters on the performance of our CNN-based pan-sharpening approach. Additionally, our CNN-based pan-sharpening approach outperforms other existing conventional pan-sharpening methods with a more promising fusion result for different landcovers, with differences in Erreur Relative Globale Adimensionnelle de Synthse (ERGAS), root-mean-squared error (RMSE), and spectral angle mapper (SAM) of 0.69, 0.0021, and 0.81 on average, respectively.

Pansharpening Using IHS Method on Multi-sensor Data and Multiple Feature Extraction Using Modified Otsu Thresholding

Multi-Spectral Remote Sensing Image Enhancement Method Based on Pca and Ihs Transformations

SSETPAN: Spatial-Spectral Enhanced Transformer Based Network for Pansharpening

An IHS-Based Pan-Sharpening Method for Spectral Fidelity Improvement Using Ripplet Transform and Compressed Sensing

Constrained Optimization Guided Approach for Multispectral and Panchromatic Image Fusion

Implementation and comparative quantitative assessment of different multispectral image pansharpening approches

A Cnn-Based Pan-Sharpening Method For Integrating Panchromatic And Multispectral Images Using Landsat 8

PAN-Guided Band-Aware Multi-Spectral Feature Enhancement for Pan-Sharpening

Pansharpening Based on Fuzzy Logic and Edge Activity

Transformer-based dual path cross fusion for pansharpening remote sensing images

Pansharpening by Combining Enhanced Spatial-Spectral Fidelity and Gradient-Domain Guided Filtering

Transformer-Based Dual-Branch Multiscale Fusion Network for Pan-Sharpening Remote Sensing Images

Pan-sharpening Based on Common Saliency Feature Analysis and Multiscale Spatial Information Extraction for Multiple Remote Sensing Images

Towards Robust Pansharpening: A Large-Scale High-Resolution Multi-Scene Dataset and Novel Approach

Object-Based Area-to-Point Regression Kriging for Pansharpening

An Improved Version of the Generalized Laplacian Pyramid Algorithm for Pansharpening

Pan-Sharpening via Multiscale Dynamic Convolutional Neural Network

PAPS: Progressive Attention-Based Pan-sharpening

Hyperspectral Pansharpening: A Review

Spatial-Frequency Domain Information Integration for Pan-Sharpening

Panchromatic and multispectral image fusion for remote sensing and earth observation: Concepts, taxonomy, literature review, evaluation methodologies and challenges ahead