Abstract:Hyperspectral super-resolution refers to the problem of fusing a hyperspectral image (HSI) and a multispectral image (MSI) to produce a super-resolution image (SRI) that has fine spatial and spectral resolution. State-of-the-art methods approach the problem via low-rank matrix approximations to the matricized HSI and MSI. These methods are effective to some extent, but a number of challenges remain. First, HSIs and MSIs are naturally third-order tensors (data "cubes") and thus matricization is prone to loss of structural information--which could degrade performance. Second, it is unclear whether or not these low-rank matrix-based fusion strategies can guarantee identifiability or exact recovery of the SRI. However, identifiability plays a pivotal role in estimation problems and usually has a significant impact on performance in practice. Third, the majority of the existing methods assume that there are known (or easily estimated) degradation operators applied to the SRI to form the corresponding HSI and MSI--which is hardly the case in practice. In this work, we propose to tackle the super-resolution problem from a tensor perspective. Specifically, we utilize the multidimensional structure of the HSI and MSI to propose a coupled tensor factorization framework that can effectively overcome the aforementioned issues. The proposed approach guarantees the identifiability of the SRI under mild and realistic conditions. Furthermore, it works with little knowledge of the degradation operators, which is clearly an advantage over the existing methods. Semi-real numerical experiments are included to show the effectiveness of the proposed approach.

What problem does this paper attempt to address?

The problem that this paper attempts to solve is to generate super - resolution images (SRI) with fine spatial and spectral resolutions by fusing hyperspectral images (HSI) and multispectral images (MSI). Specifically, most of the existing methods rely on low - rank matrix approximation, but these methods have the following challenges: 1. **Loss of structural information**: Hyperspectral and multispectral images are natural third - order tensors (data cubes), and the existing matrix - based methods are prone to losing this structural information, thus affecting performance. 2. **Identifiability problem**: Current methods cannot guarantee the uniqueness and accurate recovery of the generated SRI, which is crucial for estimation problems in practical applications. 3. **Degradation operator assumption**: Most existing methods assume that the degradation operators from SRI to HSI and MSI are known or can be easily estimated, which is difficult to achieve in practice. To solve these problems, this paper proposes a new method based on tensor decomposition. This method takes advantage of the multi - dimensional structures of HSI and MSI and proposes a coupled tensor decomposition framework, which can effectively overcome the above challenges. Specific contributions are as follows: - **Maintaining structural information**: By representing HSI and MSI as third - order tensors, the information loss caused by matrix - ization is avoided. - **Guaranteeing identifiability**: Under reasonable conditions, the proposed model can guarantee the uniqueness and accurate recovery of SRI. - **Reducing dependence on degradation operators**: This method can work in the case of unknown degradation operators and has stronger practicality. The effectiveness of this method has been proven through semi - real numerical experiments.

Hyperspectral Super-Resolution: A Coupled Tensor Factorization Approach

Hyperspectral Super-Resolution: A Coupled Nonnegative Block-Term Tensor Decomposition Approach

Hyperspectral Super-Resolution via Interpretable Block-Term Tensor Modeling

Hyperspectral super-resolution via low rank tensor triple decomposition

Hyperspectral Super-Resolution Using Nonlinear Unmixing and Nonnegative Tensor Factorization

Superpixel-Based Nonnegative Tensor Factorization for Hyperspectral Unmixing

High-Order Coupled Fully-Connected Tensor Network Decomposition for Hyperspectral Image Super-Resolution

Optimization-Based Hyperspectral Spatiotemporal Super-Resolution

A Generalized Tensor Formulation for Hyperspectral Image Super-Resolution Under General Spatial Blurring

Hyperspectral-Multispectral Image Fusion via Tensor Ring and Subspace Decompositions

A Coupled Tensor Double-Factor Method for Hyperspectral and Multispectral Image Fusion

Hyperspectral Image Super-Resolution Via Deep Prior Regularization with Parameter Estimation

Hyperspectral Image Super-Resolution Using Deep Feature Matrix Factorization

Hyperspectral Image Super-Resolution Based on Tensor Spatial-Spectral Joint Correlation Regularization

Nonlocal Patch Tensor Sparse Representation for Hyperspectral Image Super-Resolution

Hyperspectral Image Super-Resolution Based on Spatial and Spectral Correlation Fusion

Hyperspectral Restoration and Fusion With Multispectral Imagery via Low-Rank Tensor-Approximation

A Variational Approach with Nonlocal Self-Similarity and Joint-Sparsity for Hyperspectral Image Super-Resolution.

Adaptive Nonnegative Sparse Representation for Hyperspectral Image Super-Resolution

Hyperspectral image superresolution: An edge-preserving convex formulation

An Iterative Regularization Method Based on Tensor Subspace Representation for Hyperspectral Image Super-Resolution