Abstract:The hyperspectral image (HSI) is capable of providing abundant and detailed spectral information in hundreds of contiguous spectral bands. While due to some practical reasons, its spatial resolution is generally lower than that of multispectral image (MSI) and panchromatic image. To deal with the limited spatial resolution issue of HSI, a low resolution (LR) HSI can be fused with a high resolution (HR) MSI of the same scene to generate an HR HSI. A novel dictionary-based HSI and MSI fusion method (SSLDF method) is proposed in this paper, in which a localized spatial-spectral dictionary pair incorporating both spatial and spectral information simultaneously is constructed and adopted, rather than the traditional spectral or spatial one. To construct the HR and LR dictionary pair, HR MSI and its spatial degradation (LR MSI) are divided into overlapped subimages. Furthermore, to reduce the dictionary scale and hence to efficiently reduce the computation cost, a localized strategy is employed for dictionary construction rather than a global one, which makes atoms of the spatial-spectral dictionary actually all patches within the subimage. Based on the appropriate assumption that the LR HSI and HR HSI (expected fusion result) can be collaboratively represented by LR dictionary and HR dictionary respectively sharing the same set of representation coefficients, the desired HR HSI is reconstructed by HR dictionary and the collaborative representation coefficients obtained with LR HSI and LR dictionary. In simulative experiments, the newly proposed SSLDF method is validated and compared with both state-of-the-art dictionary-based fusion methods and representative fusion methods not limited to the dictionary-based ones. Simulative experimental results illustrate that the proposed fusion method is capable of producing better or comparable fused results compared with these representative fusion methods. Its simple structure as well as low computation cost makes it quite promising in practical applications.

High resolution snapshot imaging spectrometer using a fusion algorithm based on grouping principal component analysis.

Snapshot Hyperspectral Imaging Based on Equalization Designed DOE

Multispectral Image Super-Resolution Via RGB Image Fusion and Radiometric Calibration

Fast Multispectral Imaging by Spatial Pixel-Binning and Spectral Unmixing

Snapshot Imaging Spectrometer Based on Pixel-Level Filter Array (PFA)

Spatial Resolution Enhancement of Remote Sensing Hyperspectral Images with Localized Spatial-Spectral Dictionary Pair

A super-resolution fusion video imaging spectrometer based on single-pixel camera

Universal high spatial resolution hyperspectral imaging using hybrid-resolution image fusion

Research on snapshot infrared computational spectral imaging technology

Design and Optimization of a Spectrometer for High-Resolution SD-OCT

High Light Efficiency Snapshot Spectral Imaging Via Spatial Multiplexing and Spectral Mixing.

A low-cost integrated hyperspectral imaging sensor with full temporal and spatial resolution at VIS-NIR wide range

Snapshot Linear-Stokes Imaging Spectropolarimeter Using Division-of-focal-plane Polarimetry and Integral Field Spectroscopy

A Notch-Mask and Dual-Prism System for Snapshot Spectral Imaging

Image Fusion of Tempo-Spatially Modulated Polarization Interference Imaging Spectrometer

HD snapshot diffractive spectral imaging and inferencing

High-quality Panchromatic Image Acquisition Method for Snapshot Hyperspectral Imaging Fourier Transform Spectrometer

High-Speed Hyperspectral Video Acquisition by Combining Nyquist and Compressive Sampling

Ultrahigh-resolution Spectrometer Based on 19 Integrated Gratings

Location and spectral extraction algorithm for a static broadband snapshot imaging spectrometer

Unified Cloud-Based Framework for Hyperspectral and Multispectral Image Fusion Incorporating Nonlocal Principles and Tensor Decomposition