Multispectral and hyperspectral images fusion based on subspace representation and nonlocal low-rank regularization

Yiguo YangDan LiYanyan LvFanqiang KongQiang Wanga The College of Astronautics,Nanjing University of Aeronautics and Astronautics,Nanjing,Chinab The Department of Control Science and Engineering,Harbin Institute of Technology,Harbin,China
DOI: https://doi.org/10.1080/01431161.2024.2339202
IF: 3.531
2024-04-18
International Journal of Remote Sensing
Abstract:Multispectral image (MSI) and hyperspectral image (HSI) fusion is a popular method for HSI super-resolution reconstruction (HSI-SR). MSI-HSI fusion problem is ill-posed and demands several image priors or regularization terms to solve accurately, which is a challenging issue. In this paper, we propose an MSI-HSI fusion model via subspace representation and nonlocal low-rank regularization (SRNLRR). SRNLRR model incorporates the global spectral correlations and spatial nonlocal similarities of HSI to improve the fusion results, where the priors complement each other. First, we use the mode- n tensor-matrix product to project latent high spatial resolution HSI (HR-HSI) into spectral subspace, which can capture spectral low-rankness and reduce computational complexity. Then, based on low-rank representation (LRR) and nonlocal processing strategy, we design a spatial nonlocal LRR regularization (spa-NLRR) and a spectral global LRR regularization (spe-GLRR). These two regularizations analyze the spatial nonlocal similarities and spectral global correlations from intermediate-level vision. Finally, we use the residual regularization program to obtain more image information and input it into the fusion model. We use alternate minimization (AM) methods to optimize the SRNLRR model and employ the alternating direction method (ADM) on spatial/spectral LRR learning. Comparison experiments between the SRNLRR method and six advanced methods on three HSI datasets indicate the superiority of our method.
imaging science & photographic technology,remote sensing
What problem does this paper attempt to address?