Abstract:Spectral super-resolution has attracted the attention of more researchers for obtaining hyperspectral images (HSIs) in a simpler and cheaper way. Although many convolutional neural network (CNN)-based approaches have yielded impressive results, most of them ignore the low-rank prior of HSIs resulting in huge computational and storage costs. In addition, the ability of CNN-based methods to capture the correlation of global information is limited by the receptive field. To surmount the problem, we design a novel low-rank tensor reconstruction network (LTRN) for spectral super-resolution. Specifically, we treat the features of HSIs as 3-D tensors with low-rank properties due to their spectral similarity and spatial sparsity. Then, we combine canonical-polyadic (CP) decomposition with neural networks to design an adaptive low-rank prior learning (ALPL) module that enables feature learning in a 1-D space. In this module, there are two core modules: the adaptive vector learning (AVL) module and the multidimensionwise multihead self-attention (MMSA) module. The AVL module is designed to compress an HSI into a 1-D space by using a vector to represent its information. The MMSA module is introduced to improve the ability to capture the long-range dependencies in the row, column, and spectral dimensions, respectively. Finally, our LTRN, mainly cascaded by several ALPL modules and feedforward networks (FFNs), achieves high-quality spectral super-resolution with fewer parameters. To test the effect of our method, we conduct experiments on two datasets: the CAVE dataset and the Harvard dataset. Experimental results show that our LTRN not only is as effective as state-of-the-art methods but also has fewer parameters. The code is available at https://github.com/renweidian/LTRN.

Locally Linear Reconstruction for Spectral Enhancement Using Limited Pixel-to-Pixel Multispectral and Hyperspectral Data

Hyperspectral Anomaly Detection Via Locally Enhanced Low-Rank Prior

Low-Rank and Sparse Matrix Recovery for Hyperspectral Image Reconstruction Using Bayesian Learning

Fast Multispectral Imaging by Spatial Pixel-Binning and Spectral Unmixing

Spectral Super-Resolution via Deep Low-Rank Tensor Representation

Mask-Guided Spatial–Spectral MLP Network for High-Resolution Hyperspectral Image Reconstruction

A Locally Optimized Model for Hyperspectral and Multispectral Images Fusion

Hyperspectral Restoration Via $L_0$ Gradient Regularized Low-Rank Tensor Factorization

Hyperspectral Image Joint Super-Resolution via Local Implicit Spatial-Spectral Function Learning

Spatial-Spectral Structured Sparse Low-Rank Representation for Hyperspectral Image Super-Resolution

Reconstruction from Multispectral to Hyperspectral Image Using Spectral Library-Based Dictionary Learning.

Hyperspectral Image Reconstruction of SD-CASSI Based on Nonlocal Low-Rank Tensor Prior

Spectral Reconstruction Network From Multispectral Images to Hyperspectral Images: A Multitemporal Case

Image Fusion for Spatial Enhancement of Hyperspectral Image via Pixel Group Based Non-Local Sparse Representation

Joint Sparse Local Linear Discriminant Analysis for Feature Dimensionality Reduction of Hyperspectral Images

Hyperspectral Feature Extraction Using Sparse and Smooth Low-Rank Analysis

Hyperspectral Image Restoration via Subspace-Based Nonlocal Low-Rank Tensor Approximation

Unsupervised Feature Extraction for Hyperspectral Images Using Combined Low Rank Representation and Locally Linear Embedding

Hyperspectral Restoration and Fusion With Multispectral Imagery via Low-Rank Tensor-Approximation

Hyperspectral and Multispectral Image Fusion via Nonlocal Low-Rank Tensor Approximation and Sparse Representation

An Efficient Method of Hyperspectral Image Dimension Reduction Based on Low Rank Representation and Locally Linear Embedding