Abstract:Hyperspectral image (HSI) and multispectral image (MSI) fusion, denoted as HSI-MSI fusion, involves merging a pair of HSI and MSI to generate a high spatial resolution HSI (HR-HSI). The primary challenge in HSI-MSI fusion is to find the best way to extract 1-D spectral features and 2-D spatial features from HSI and MSI and harmoniously combine them. In recent times, coupled tensor decomposition (CTD)-based methods have shown promising performance in the fusion task. However, the tensor decompositions (TDs) used by these CTD-based methods face difficulties in extracting complex features and capturing 2-D spatial features, resulting in suboptimal fusion results. To address these issues, we introduce a novel method called coupled tensor double-factor (CTDF) decomposition. Specifically, we propose a tensor double-factor (TDF) decomposition, representing a third-order HR-HSI as a fourth-order spatial factor and a third-order spectral factor, connected through a tensor contraction. Compared to other TDs, the TDF has better feature extraction capability since it has a higher order factor than that of HR-HSI, whereas the other TDs only have the same order factor as the HR-HSI. Moreover, the TDF can extract 2-D spatial features using the fourth-order spatial factor. We apply the TDF to the HSI-MSI fusion problem and formulate the CTDF model. Furthermore, we design an algorithm based on proximal alternating minimization (PAM) to solve this model and provide insights into its computational complexity and convergence analysis. The simulated and real experiments validate the effectiveness and efficiency of the proposed CTDF method. The code is available at https://github.com/tingxu113/CTDF.

Bayesian Hyperspectral and Multispectral Image Fusions via Double Matrix Factorization.

Infrared and Visible Image Fusion Via Variational Bayesian Approximation Method

Deep Hyperspectral and Multispectral Image Fusion Via Probabilistic Matrix Factorization.

Hyperspectral and Multispectral Image Fusion Based on Deep Attention Network.

Bayesian Fusion of Multi-Band Images

Variational Bayesian Image Fusion Based On Combined Sparse Representations

Deep Image Fusion Accounting for Inter-Image Variability.

Bayesian Fusion of Hyperspectral and Multispectral Images Using Gaussian Scale Mixture Prior

Hyperspectral and Multispectral Image Fusion with Dual-Source Spatial-Spectral Dictionary.

Multispectral and Hyperspectral Image Fusion Based on Regularized Coupled Non-Negative Block-Term Tensor Decomposition

Bayesian decision based fusion algorithm for remote sensing images

Remote Sensing Image Fusion Based on Bayesian Linear Estimation

Hyperspectral and Multispectral Image Fusion based on a Sparse Representation

A Hybrid Pan-Sharpening Approach Using Nonnegative Matrix Factorization for WorldView Imageries.

Hyperspectral and Multispectral Image Fusion Based on Low Rank Constrained Gaussian Mixture Model.

Deep Hyperspectral and Multispectral Image Fusion with Inter-image Variability

Hyperspectral and Multispectral Image Fusion via Nonlocal Low-Rank Tensor Approximation and Sparse Representation

The Realistic Fusion of Multi-spectral Images

HYPERSPECTRAL AND MULTISPECTRAL IMAGE FUSION USING DUAL-SOURCE LOCALIZED DICTIONARY PAIR

Remote sensing image fusion based on sparse non-negative matrix factorization

A Coupled Tensor Double-Factor Method for Hyperspectral and Multispectral Image Fusion