Abstract:Multispectral and hyperspectral image fusion (MHF) aims to reconstruct high-resolution hyperspectral images by fusing spatial and spectral information. Unlike the traditional canonical polyadic decomposition and Tucker decomposition models, the block-term tensor decomposition model is able to improve the quality of fused images using known endmember and abundance information. This paper presents an improved hyperspectral image fusion algorithm. Firstly, the two abundance matrices are combined into a single bulk matrix to promote structural sparsity by introducing the L2,1-norm to eliminate the scaling effects present in the model. Secondly, the counter-scaling effect is eliminated by adding the L2-norm to the endmember matrix. Finally, the chunk matrix and the endmember matrix are coupled together, and the matrix is reorganized by adding the L2,1-norm to the matrix to facilitate chunk elimination and solved using an extended iterative reweighted least squares (IRLS) method, focusing on the problem of the inability to accurately estimate the tensor rank in the chunk-term tensor decomposition model and the noise/artifact problem arising from overestimation of rank. Experiments are conducted on standard and local datasets, and the fusion results are compared and analyzed in four ways: visual result analysis, metric evaluation, time of the algorithm, and classification results, and the experimental results show that the performance of the proposed method is better than the existing methods. An extensive performance evaluation of the algorithms is performed by conducting experiments on different datasets. The experimental results show that the proposed algorithm achieves significant improvements in terms of reconstruction error, signal-to-noise ratio, and image quality compared with the existing methods. Especially in the case of a low signal-to-noise ratio, the proposed algorithm shows stronger robustness and accuracy. These results show that the proposed algorithm has significant advantages in dealing with multispectral high-resolution hyperspectral data.

Unsupervised Hyperspectral Imagery Classification Via Sparse Multi-Way Models and Image Fusion

Band-Subset-Based Clustering and Fusion for Hyperspectral Imagery Classification

Multi-information fusion sparse coding with preserving local structure for hyperspectral image classification

Supervised Hyperspectral Image Classification Combining Sparse Unmixing and Spatial Constraint

Unsupervised Hyperspectral and Multispectral Image Fusion with Deep Spectral-Spatial Collaborative Constraint

Hyperspectral Image Classification by Fusing Sparse Representation and Simple Linear Iterative Clustering

Hyperspectral Image Classification Using Multi-Feature Fusion

An Unsupervised Hyperspectral Image Fusion Method Based on Spectral Unmixing and Deep Learning.

Hyperspectral-multispectral image fusion using subspace decomposition and Elastic Net Regularization

Image Fusion for Spatial Enhancement of Hyperspectral Image via Pixel Group Based Non-Local Sparse Representation

Multi-Objective Sparse Subspace Clustering for Hyperspectral Imagery

Multispectral and Hyperspectral Image Fusion Based on Joint-Structured Sparse Block-Term Tensor Decomposition

Hyperspectral Image Classification Based on Semisupervised Self-Learning and Multiview Information Fusion

Hyperspectral and Multispectral Image Fusion Via Nonlocal Low-Rank Tensor Decomposition and Spectral Unmixing

A Multidimensional Feature Fusion Method for Unsupervised Hyperspectral Information Extraction

Collaborative Classification of Hyperspectral and Visible Images with Convolutional Neural Network

Efficient Superpixel-Level Multitask Joint Sparse Representation for Hyperspectral Image Classification

Efficient superpixel-oriented multi-task joint sparse representation classification for hyperspectral imagery

Unsupervised 3-D Tensor Subspace Decomposition Network for Spatial–Temporal–Spectral Fusion of Hyperspectral and Multispectral Images

A Superpixel-Correlation-Based Multiview Approach for Hyperspectral Image Classification

From Subpixel to Superpixel: A Novel Fusion Framework for Hyperspectral Image Classification