NF-3DLogTNN: an Effective Hyperspectral and Multispectral Image Fusion Method Based on Nonlocal Low-Fibered-rank Regularization

Cheng-Wei Sun,Ting -Zhu Huang,Ting Xu,Liang-Jian Deng
DOI: https://doi.org/10.1016/j.apm.2023.02.012
IF: 5.336
2023-01-01
Applied Mathematical Modelling
Abstract:In this paper, we develop a framelet representation of the three-directional log-based ten-sor nuclear norm (F-3DLogTNN) for hyperspectral and multispectral image fusion (HSI-MSI fusion). The three-directional log-based tensor nuclear norm, as the nonconvex re-laxation of tensor fibered rank, is computed by mode-n tensor singular value decompo-sition (t-SVD) based on the mode-n tensor-tensor product (t-prod). The mode-n t-prod is based on the mode-n discrete Fourier transform. Hereafter, we suggest using the mode -n framelet transform to define the mode-n t-prod and subsequently the mode-n t-SVD. Due to the redundancy of the framelet basis, each fiber along mode-n of the tensor can be sparsely represented. When the tensor's slices (including frontal, lateral, and horizontal slices) are correlated, respectively, the corresponding sum of the rank of framelet trans-formed slices should be small. Thereby, there has lower tensor fibered rank performance. With that, we propose a novel nonlocal low-fibered-rank regularization to depict the lo-cal spatial-spectral correlation and nonlocal self-similarity of high-spatial-resolution hyper -spectral image. Since minimizing the fibered rank directly is an NP-hard problem, we sug-gest F-3DLogTNN as its nonconvex relaxation. Subsequently, nonlocal based F-3DLogTNN (NF-3DLogTNN) method is developed for HSI-MSI fusion. To deal with the proposed model, we design an algorithm based on the alternating direction multipliers method. Experi-mental results on three datasets prove the proposed method's superiority over the related state-of-the-art HSI-MSI fusion methods. (c) 2023 Published by Elsevier Inc.
What problem does this paper attempt to address?