Abstract:Coded aperture snapshot spectral imaging (CASSI) is an important technique for capturing three-dimensional (3D) hyperspectral images (HSIs), and involves an inverse problem of reconstructing the 3D HSI from its corresponding coded 2D measurements. Existing model-based and learning-based methods either could not explore the implicit feature of different HSIs or require a large amount of paired data for training, resulting in low reconstruction accuracy or poor generalization performance as well as interpretability. To remedy these deficiencies, this paper proposes a novel HSI reconstruction method, which exploits the global spectral correlation from the HSI itself through a formulation of model-driven low-rank subspace representation and learns the deep prior by a data-driven self-supervised deep learning scheme. Specifically, we firstly develop a model-driven low-rank subspace representation to decompose the HSI as the product of an orthogonal basis and a spatial representation coefficient, then propose a data-driven deep guided spatial-attention network (called DGSAN) to adaptively reconstruct the implicit spatial feature of HSI by learning the deep coefficient prior (DCP), and finally embed these implicit priors into an iterative optimization framework through a self-supervised training way without requiring any training data. Thus, the proposed method shall enhance the reconstruction accuracy, generalization ability, and interpretability. Extensive experiments on several datasets and imaging systems validate the superiority of our method. The source code and data of this article will be made publicly available at https://github.com/ChenYong1993/LRSDN.

Prior Image Guided Snapshot Compressive Spectral Imaging

Hyperspectral image recovery based on fusion of coded aperture snapshot spectral imaging and RGB images by guided filtering

Hybrid Compressive Spectral Imaging with Coded Aperture Optimization Based on Coherence Minimization

Simultaneous Coded Aperture and Dictionary Optimization in Compressive Spectral Imaging Via Coherence Minimization.

Residual image recovery method based on the dual-camera design of a compressive hyperspectral imaging system

Compressive Single-Pixel Spectral Imaging with Spatial-Spectral Modulation Optimization Via Coherence Minimization

Snapshot Spectral Imaging Based on Aberration Model-Driven Deep Learning

Development of Energy Correction Based Multishot Snapshot Spectral Imaging System

Compressive Single-Pixel Hyperspectral Imaging Using RGB Sensors

Compressed Sensing Fourier Single Pixel Imaging Algorithm Based on Joint Discrete Gradient and Non-Local Self-Similarity Priors

Progressive Content-Aware Coded Hyperspectral Snapshot Compressive Imaging

Deep-learning-based CASSI Reconstruction with Optical Aberration Correction

Convolutional Neural Network Based Computational Imaging Spectroscopy

Plug-and-Play Priors for Multi-Shot Compressive Hyperspectral Imaging

Progressive Content-aware Coded Hyperspectral Compressive Imaging

Fast Hyperspectral Image Recovery via Non-iterative Fusion of Dual-Camera Compressive Hyperspectral Imaging

A Fast Alternating Minimization Algorithm for Coded Aperture Snapshot Spectral Imaging Based on Sparsity and Deep Image Priors

Efficient One-Step Diffusion Refinement for Snapshot Compressive Imaging

Hyperspectral Compressive Snapshot Reconstruction via Coupled Low-Rank Subspace Representation and Self-Supervised Deep Network

Hyperspectral Imaging Based on Prior Image Constrained Compressive Sensing

Multi-spectral compressive snapshot imaging using RGB image sensors