Abstract:The difference and complementarity of spatial and spectral information between multispectral (MS) image and panchromatic (PAN) image have laid the foundation for the fusion of the two types of images. In recent years, MS and PAN image fusion (also known as MS-Pansharpening) has gained attention as an important research area in remote sensing (RS) image processing. This paper proposes an MS-Pansharpening algorithm based on dual constraint Guided Filtering in the nonsubsampled shearlet transform (NSST) domain. The innovation is threefold. First, the dual constraint guided image filtering (DCGIF) model, based on spatial region average gradient correlation and vector correlation formed by neighborhood elements is proposed. Further, the PAN image detail information extraction scheme, based on the model, is provided, which extracts more complete and accurate detail information, thus avoiding, to some extent, the spectral distortion caused by the injection of non-adaptive information. Second, the weighted information injection model, based on the preservation of the correlation between the band spectra, is proposed. The model determines the information injection weight of each band pixel based on the spectral proportion between bands of the original MS image, which ensures the spectral correlation between bands of the fused MS image. Finally, a new MS-Pansharpening algorithm in NSST domain is proposed. The MS and PAN high frequency sub-bands of NSST are used to extract more effective spatial details. Then the proposed DCGIF model is used to extract the effective spatial detail injection information through the weighted joint method based on the regional energy matrix. Finally, the weighted information injection model is used to inject it into each band of MS to complete information fusion. Experimental results show that the proposed approach has better fusion effect than some conventional MS-Pansharpening algorithms, which can effectively improve the spatial resolution of the fused MS image and maintain the spectral characteristics of MS.

Pan-sharpening via regional division and NSST

Learning Interpolation Via Regional Map for Pan-Sharpening

Pan-sharpening Via Multi-Scale and Multiple Deep Neural Networks

MS-Pansharpening Algorithm Based on Dual Constraint Guided Filtering

A Pan-Sharpening Method with Beta-Divergence Non-Negative Matrix Factorization in Non-Subsampled Shear Transform Domain

A New Pansharpening Method Using Multistage Joint Bilateral Filtering

The PAN and MS Image Pansharpening Algorithm Based on Adaptive Neural Network and Sparse Representation in the NSST Domain

Refined Pan-Sharpening with NSCT and Hierarchical Sparse Autoencoder.

A NSST Pansharpening Method Based on Directional Neighborhood Correlation and Tree Structure Matching

Pan-Sharpening Using 2d Cca

Pansharpening Based on Joint Gaussian Guided Upsampling.

Pansharpening Based On An Improved Ratio Enhancement

Pan-Sharpening Based on Improvement of Panchromatic Image to Minimize Spectral Distortion.

Pan-sharpening Method Based on Unsupervised and Divide-and-conquer Strategies

Pansharpening Based on Multimodal Texture Correction and Adaptive Edge Detail Fusion

Pan-Sharpening by Multilevel Interband Structure Modeling.

A Multi-Direction Subbands And Deep Neural Networks Bassed Pan-Sharpening Method

Fusion of Multispectral and Panchromatic Images Via Local Geometrical Similarity

Pan-Sharpening with Hessian Nuclear Norm Induced Spatial Consistency.

Pan-Sharpening Of Remote Sensing Images Via Graph Regularized Sparse Coding

Pan-Sharpening Based on Multilevel Coupled Deep Network