Abstract:Hyperspectral image (HSI) reconstruction from the compressed measurement captured by the coded aperture snapshot spectral imager system remains a hot topic. Recently, deep-learning-based methods for HSI reconstruction have become the mainstream due to their high performance and efficiency in the testing inference. However, these learning methods do not fully utilize the abundant spectral information with proper physical spectral priors, resulting in complex architectures and unsatisfactory reconstruction performance. In this paper, we claim that the spectral low-rank property can still help these learning methods and propose a hyperspectral fusion theory, which demonstrates that full HSIs are mathematically equivalent to the closed-form combination of subspace images, mask, and measurements. Based on the above fusion theory, we propose the subspace distillation prior (SP) to efficiently cooperate with existing learning models to enhance the exploration of the spectral low-rank property. In detail, the SP can directly improve the testing inference of existing models (SP1, Section 4.1). Furthermore, SP can also be cooperated with exiting networks to formulate a new framework, which regularizes the existing models to learn the subspace images, and help to reconstruct the full HSIs from subspace images, mask, and measurements (SP2, Section 4.2). We choose six existing representative models for the HSI reconstruction experiments and find that SP1 and SP2 can, respectively, achieve improvements of 0.08 dB ∼ 0.76 dB and 0.36 dB ∼ 1.76 dB on the simulated datasets, demonstrating the advantage of the proposed hyperspectral fusion theory. The source code is available at https://github.com/prowDIY .

Hyper-spectral Image Reconstruction Based on SL0-SL0 Minimization

Hyper-Spectral Image Reconstruction Based On Sl0-Sl0 Minimization

Hyperspectral Imaging Based on Prior Image Constrained Compressive Sensing

Spatial-spectral Encoding and Dictionary Optimization in Compressive Single-Pixel Hyperspectral Imaging Based on Mutual Coherence Minimization

Compressive Single-Pixel Spectral Imaging with Spatial-Spectral Modulation Optimization Via Coherence Minimization

Three-stages Hyperspectral Image Compression Sensing with Band Selection

Compressed Sensing Fourier Single Pixel Imaging Algorithm Based on Joint Discrete Gradient and Non-Local Self-Similarity Priors

Hybrid Compressive Spectral Imaging with Coded Aperture Optimization Based on Coherence Minimization

Compressive Single-Pixel Hyperspectral Imaging Using RGB Sensors

Compressive Hyperspectral Imaging with Spatial and Spectral Priors

Spatial-spectral Encoded Compressive Hyperspectral Imaging

Cluster Sparsity Field: an Internal Hyperspectral Imagery Prior for Reconstruction

Hyperspectral Compressive Sensing Using Manifold-Structured Sparsity Prior

Hyperspectral Image Compression and Reconstruction Based on Block-Sparse Dictionary Learning

Hyperspectral Compressive Snapshot Reconstruction via Coupled Low-Rank Subspace Representation and Self-Supervised Deep Network

A Fast Alternating Minimization Algorithm for Coded Aperture Snapshot Spectral Imaging Based on Sparsity and Deep Image Priors

Fast Multispectral Imaging by Spatial Pixel-Binning and Spectral Unmixing

Low-Rank and Sparse Matrix Recovery for Hyperspectral Image Reconstruction Using Bayesian Learning

An interpretable and flexible fusion prior to boost hyperspectral imaging reconstruction

Hyperspectral image superresolution: An edge-preserving convex formulation

Hyperspectral image restoration based on color superpixel segmentation