Abstract:Multispectral and hyperspectral image fusion (MHF) aims to reconstruct high-resolution hyperspectral images by fusing spatial and spectral information. Unlike the traditional canonical polyadic decomposition and Tucker decomposition models, the block-term tensor decomposition model is able to improve the quality of fused images using known endmember and abundance information. This paper presents an improved hyperspectral image fusion algorithm. Firstly, the two abundance matrices are combined into a single bulk matrix to promote structural sparsity by introducing the L2,1-norm to eliminate the scaling effects present in the model. Secondly, the counter-scaling effect is eliminated by adding the L2-norm to the endmember matrix. Finally, the chunk matrix and the endmember matrix are coupled together, and the matrix is reorganized by adding the L2,1-norm to the matrix to facilitate chunk elimination and solved using an extended iterative reweighted least squares (IRLS) method, focusing on the problem of the inability to accurately estimate the tensor rank in the chunk-term tensor decomposition model and the noise/artifact problem arising from overestimation of rank. Experiments are conducted on standard and local datasets, and the fusion results are compared and analyzed in four ways: visual result analysis, metric evaluation, time of the algorithm, and classification results, and the experimental results show that the performance of the proposed method is better than the existing methods. An extensive performance evaluation of the algorithms is performed by conducting experiments on different datasets. The experimental results show that the proposed algorithm achieves significant improvements in terms of reconstruction error, signal-to-noise ratio, and image quality compared with the existing methods. Especially in the case of a low signal-to-noise ratio, the proposed algorithm shows stronger robustness and accuracy. These results show that the proposed algorithm has significant advantages in dealing with multispectral high-resolution hyperspectral data.

Hyperspectral image fusion by multiplication of spectral constraint and NMF

Hyperspectral Image Fusion Via Sc- NMF

Unaligned Hyperspectral Image Fusion Via Registration and Interpolation Modeling

Hyperspectral image fusion based on sparse constraint NMF

HyperFusion: A Computational Approach for Hyperspectral, Multispectral, and Panchromatic Image Fusion

A Hybrid Pan-Sharpening Approach Using Nonnegative Matrix Factorization for WorldView Imageries.

The Realistic Fusion of Multi-spectral Images

Unregistered Hyperspectral and Multispectral Image Fusion with Synchronous Nonnegative Matrix Factorization.

Hyperspectral and Multispectral Image Fusion Via Nonlocal Low-Rank Tensor Decomposition and Spectral Unmixing

Multispectral and Hyperspectral Image Fusion Based on Joint-Structured Sparse Block-Term Tensor Decomposition

Hyperspectral And Multispectral Image Fusion Based On Spectral Low Rank And Non-Local Spatial Similarities

Nonnegative Matrix Factorization-Based Hyperspectral and Panchromatic Image Fusion.

Study on WorldView-2 Image Fusion Method Based on NMF and HCS Transform

Hyperspectral and Multispectral Image Fusion Based on Local Low Rank and Coupled Spectral Unmixing

Hyperspectral And Multispectral Image Fusion Based On Constrained Cnmf Unmixing

Image Fusion for Spatial Enhancement of Hyperspectral Image via Pixel Group Based Non-Local Sparse Representation

Hyperspectral and Multispectral Image Fusion Based on Low Rank Constrained Gaussian Mixture Model.

Fusion of Hyperspectral and Multispectral Images: A Novel Framework Based on Generalization of Pan-Sharpening Methods

Hyperspectral Image Resolution Enhancement Using High-Resolution Multispectral Image Based on Spectral Unmixing

Hyperspectral and multispectral image fusion via tensor sparsity regularization

Hyperspectral and Panchromatic Image Fusion Via Adaptive Tensor and Multi-Scale Retinex Algorithm