Abstract:The difference and complementarity of spatial and spectral information between multispectral (MS) image and panchromatic (PAN) image have laid the foundation for the fusion of the two types of images. In recent years, MS and PAN image fusion (also known as MS-Pansharpening) has gained attention as an important research area in remote sensing (RS) image processing. This paper proposes an MS-Pansharpening algorithm based on dual constraint Guided Filtering in the nonsubsampled shearlet transform (NSST) domain. The innovation is threefold. First, the dual constraint guided image filtering (DCGIF) model, based on spatial region average gradient correlation and vector correlation formed by neighborhood elements is proposed. Further, the PAN image detail information extraction scheme, based on the model, is provided, which extracts more complete and accurate detail information, thus avoiding, to some extent, the spectral distortion caused by the injection of non-adaptive information. Second, the weighted information injection model, based on the preservation of the correlation between the band spectra, is proposed. The model determines the information injection weight of each band pixel based on the spectral proportion between bands of the original MS image, which ensures the spectral correlation between bands of the fused MS image. Finally, a new MS-Pansharpening algorithm in NSST domain is proposed. The MS and PAN high frequency sub-bands of NSST are used to extract more effective spatial details. Then the proposed DCGIF model is used to extract the effective spatial detail injection information through the weighted joint method based on the regional energy matrix. Finally, the weighted information injection model is used to inject it into each band of MS to complete information fusion. Experimental results show that the proposed approach has better fusion effect than some conventional MS-Pansharpening algorithms, which can effectively improve the spatial resolution of the fused MS image and maintain the spectral characteristics of MS.

Pansharpening Based on Multimodal Texture Correction and Adaptive Edge Detail Fusion

Efficient and Accurate Hyperspectral Pansharpening Using 3D VolumeNet and 2.5D Texture Transfer

SSETPAN: Spatial-Spectral Enhanced Transformer Based Network for Pansharpening

Pansharpening Based on Joint Gaussian Guided Upsampling.

A New Pansharpening Method Using Multistage Joint Bilateral Filtering

Pansharpening by Combining Enhanced Spatial-Spectral Fidelity and Gradient-Domain Guided Filtering

MS-Pansharpening Algorithm Based on Dual Constraint Guided Filtering

A Unified Pansharpening Method with Structure Tensor Driven Spatial Consistency and Deep Plug-and-Play Priors

Pan-Sharpening Based on Multilevel Coupled Deep Network

Multispectral Pansharpening Based on Multisequence Convolutional Recurrent Neural Network

Pansharpening via Unsupervised Convolutional Neural Networks

Pansharpening for Multiband Images with Adaptive Spectral–Intensity Modulation

Pansharpening via sparse regression

Pansharpening Based on Fuzzy Logic and Edge Activity

Convolutional Neural Network for Pansharpening with Spatial Structure Enhancement Operator

Pansharpening by Jointing Spectral Mapping and Detail Injection Chinese Full Text

Pansharpening Based On An Improved Ratio Enhancement

Pansharpening Via Triplet Attention Network with Information Interaction

Pan-sharpening Via Multi-Scale and Multiple Deep Neural Networks

Spectral-Driven Pansharpening Using Adaptive Image Segmentation To Reduce Color Distortion

Pansharpening via Frequency-Aware Fusion Network With Explicit Similarity Constraints