Abstract:The increasing availability of sensors enables the combination of a high-spatial-resolution panchromatic image and a low-spatial-resolution multispectral image, which has become a hotspot in recent years for many applications. To address the spectral and spatial distortions that adversely affect the conventional methods, a pan-sharpening method based on a convolutional neural network (CNN) architecture is proposed in this paper, where the low-spatial-resolution multispectral image is upgraded and integrated with the high-spatial-resolution panchromatic image to produce a new multispectral image with high spatial resolution. Based on the pyramid structure of the CNN architecture, the proposed method has high learning capacity to generate more representative and robust hierarchical features for construction tasks. Moreover, the highly nonlinear fusion process can be effectively simulated by stacking several linear filtering layers, which is suitable for learning the complex mapping relationship between a high-spatial-resolution panchromatic and low-spatial-resolution multispectral image. Both qualitative and quantitative experimental analyses were carried out on images captured from a Landsat 8 on-board operational land imager (LOI) sensor to demonstrate the method's performance. The results regarding the sensitivity analysis of the involved parameters indicate the effects of parameters on the performance of our CNN-based pan-sharpening approach. Additionally, our CNN-based pan-sharpening approach outperforms other existing conventional pan-sharpening methods with a more promising fusion result for different landcovers, with differences in Erreur Relative Globale Adimensionnelle de Synthse (ERGAS), root-mean-squared error (RMSE), and spectral angle mapper (SAM) of 0.69, 0.0021, and 0.81 on average, respectively.

A Pan-Sharpening Method Appropriate to Vegetation Applications

An IHS-Based Pan-Sharpening Method for Spectral Fidelity Improvement Using Ripplet Transform and Compressed Sensing

A variational approach for pan-sharpening.

Joint Ihs And Variational Methods For Pan-Sharpening Of Very High Resolution Imagery

A Pan-Sharpening Method Based on Evolutionary Optimization and IHS Transformation

MIHS: A Multiobjective Pan-sharpening Method for Remote Sensing Images.

A Pan-Sharpening Method Based on the ADMM Algorithm

Pan-sharpening using a guided filter

Variational PCA Fusion for Pan-sharpening Very High Resolution Imagery

A review of image fusion techniques for pan-sharpening of high-resolution satellite imagery

Pan-Sharpening by Multilevel Interband Structure Modeling.

An Improved Adaptive Intensity–Hue–Saturation Method for the Fusion of Remote Sensing Images

Pan-sharpening of multi-spectral images using a new variational model

A Two-Stage Pansharpening Method for the Fusion of Remote-Sensing Images

Pansharpening Based on Fuzzy Logic and Edge Activity

A Cnn-Based Pan-Sharpening Method For Integrating Panchromatic And Multispectral Images Using Landsat 8

Pan-Sharpening via Multiscale Dynamic Convolutional Neural Network

PAN-Guided Band-Aware Multi-Spectral Feature Enhancement for Pan-Sharpening

Pansharpening Using Guided Filtering to Improve the Spatial Clarity of VHR Satellite Imagery

Pan-sharpening: a Fast Variational Fusion Approach

An improved non-subsampled contourlet transform-based hybrid pan-sharpening algorithm.