Abstract:Hyperspectral imaging is capable of acquiring the rich spectral information of scenes and has great potential for understanding the characteristics of different materials in many applications ranging from remote sensing to medical imaging. However, due to hardware limitations, the existed hyper-/multi-spectral imaging devices usually cannot obtain high spatial resolution. This study aims to generate a high resolution hyperspectral image according to the available low resolution hyperspectral and high resolution RGB images. We propose a novel hyperspectral image superresolution method via non-negative sparse representation of reflectance spectra with a data guided sparsity constraint. The proposed method firstly learns the hyperspectral dictionary from the low resolution hyperspectral image and then transforms it into the RGB one with the camera response function, which is decided by the physical property of the RGB imaging camera. Given the RGB vector and the RGB dictionary, the sparse representation of each pixel in the high resolution image is calculated with the guidance of a sparsity map, which measures pixel material purity. The sparsity map is generated by analyzing the local content similarity of a focused pixel in the available high resolution RGB image and quantifying the spectral mixing degree motivated by the fact that the pixel spectrum of a pure material should have sparse representation of the spectral dictionary. Since the proposed method adaptively adjusts the sparsity in the spectral representation based on the local content of the available high resolution RGB image, it can produce more robust spectral representation for recovering the target high resolution hyperspectral image. Comprehensive experiments on two public hyperspectral datasets and three real remote sensing images validate that the proposed method achieves promising performances compared to the existing state-of-the-art methods.

Spatial-Spectral Structured Sparse Low-Rank Representation for Hyperspectral Image Super-Resolution

Hyperspectral Image Super-Resolution via Non-Negative Structured Sparse Representation

Remote Sensing Hyperspectral Image Super-Resolution via Multidomain Spatial Information and Multiscale Spectral Information Fusion

Spectral Super-Resolution Based on Dictionary Optimization Learning via Spectral Library

Fusion of Hyperspectral-Multispectral images joining Spatial-Spectral Dual-Dictionary and structured sparse Low-rank representation

Self-Similarity Constrained Sparse Representation for Hyperspectral Image Super-Resolution.

Hyperspectral Image Joint Super-Resolution via Local Implicit Spatial-Spectral Function Learning

Hyperspectral Image Super-Resolution via Deep Spatiospectral Attention Convolutional Neural Networks

Hyper-Spectral Image Super-Resolution Using Non-Negative Spectral Representation with Data-Guided Sparsity

Hyperspectral Image Super-Resolution Using Sparse Spectral Unmixing and Low-Rank Constraints

Hyperspectral Image Super-resolution via Deep Spatio-spectral Convolutional Neural Networks

Spectral Representation Via Data-Guided Sparsity for Hyperspectral Image Super-Resolution

Hyperspectral Image Super-Resolution with Self-Supervised Spectral-Spatial Residual Network

Hyperspectral Image Superresolution via Deep Structure and Texture Interfusion

Hyperspectral image super-resolution via a multi-stage scheme without employing spatial degradation

Multispectral and hyperspectral images fusion based on subspace representation and nonlocal low-rank regularization

An Iterative Regularization Method Based on Tensor Subspace Representation for Hyperspectral Image Super-Resolution

Nonlocal Patch Tensor Sparse Representation for Hyperspectral Image Super-Resolution

Learning Spatial-Spectral Prior for Super-Resolution of Hyperspectral Imagery

Hyperspectral Image Super-Resolution via Dual-domain Network Based on Hybrid Convolution

Hyperspectral and multispectral image fusion with arbitrary resolution through self-supervised representations