Abstract:Hyperspectral imaging is capable of acquiring the rich spectral information of scenes and has great potential for understanding the characteristics of different materials in many applications ranging from remote sensing to medical imaging. However, due to hardware limitations, the existed hyper-/multi-spectral imaging devices usually cannot obtain high spatial resolution. This study aims to generate a high resolution hyperspectral image according to the available low resolution hyperspectral and high resolution RGB images. We propose a novel hyperspectral image superresolution method via non-negative sparse representation of reflectance spectra with a data guided sparsity constraint. The proposed method firstly learns the hyperspectral dictionary from the low resolution hyperspectral image and then transforms it into the RGB one with the camera response function, which is decided by the physical property of the RGB imaging camera. Given the RGB vector and the RGB dictionary, the sparse representation of each pixel in the high resolution image is calculated with the guidance of a sparsity map, which measures pixel material purity. The sparsity map is generated by analyzing the local content similarity of a focused pixel in the available high resolution RGB image and quantifying the spectral mixing degree motivated by the fact that the pixel spectrum of a pure material should have sparse representation of the spectral dictionary. Since the proposed method adaptively adjusts the sparsity in the spectral representation based on the local content of the available high resolution RGB image, it can produce more robust spectral representation for recovering the target high resolution hyperspectral image. Comprehensive experiments on two public hyperspectral datasets and three real remote sensing images validate that the proposed method achieves promising performances compared to the existing state-of-the-art methods.

Jointly Spatial-Spectral Resolution Enhancement of Hyperspectral Imagery.

Unaligned Hyperspectral Image Fusion Via Registration and Interpolation Modeling

Multispectral Image Super-Resolution Via RGB Image Fusion and Radiometric Calibration

Image Fusion for Spatial Enhancement of Hyperspectral Image via Pixel Group Based Non-Local Sparse Representation

Spectral-Spatial Classification of Hyperspectral Images Using Joint Bilateral Filter and Graph Cut Based Model.

Boosting Image Super-Resolution Via Fusion of Complementary Information Captured by Multi-Modal Sensors

A spectral and spatial transformer for hyperspectral remote sensing image super-resolution

Hyperspectral Image Super-Resolution via Dual-domain Network Based on Hybrid Convolution

A Spectral–Spatial Jointed Spectral Super-Resolution and Its Application to HJ-1A Satellite Images

Connecting Low-Level and High-Level Visions: A Joint Optimization for Hyperspectral Image Super-Resolution and Target Detection

Hyper-Spectral Image Super-Resolution Using Non-Negative Spectral Representation with Data-Guided Sparsity

Fusion of Dual Spatial Information for Hyperspectral Image Classification

Fusion of Hyperspectral and Multispectral Images: A Novel Framework Based on Generalization of Pan-Sharpening Methods

Remote Sensing Hyperspectral Image Super-Resolution via Multidomain Spatial Information and Multiscale Spectral Information Fusion

Spectral-Spatial Residual Network for Fusing Hyperspectral and Panchromatic Remote Sensing Images

Spectral Representation Via Data-Guided Sparsity for Hyperspectral Image Super-Resolution

Exploring the Spectral Prior for Hyperspectral Image Super-Resolution

A Review of Spatial Enhancement of Hyperspectral Remote Sensing Imaging Techniques

Spatial-Spectral Middle Cross-Attention Fusion Network for Hyperspectral Image Superresolution

An Optimized Inversion Method for Hyperspectral Image Fusion Based on a Hue–Intensity–Saturation, Wavelet, and Trust-Region Conjugate Gradient Method

A Super-Resolution Algorithm Based on Hybrid Network for Multi-Channel Remote Sensing Images