Abstract:Coded aperture snapshot spectral imaging (CASSI) is an important technique for capturing three-dimensional (3D) hyperspectral images (HSIs), and involves an inverse problem of reconstructing the 3D HSI from its corresponding coded 2D measurements. Existing model-based and learning-based methods either could not explore the implicit feature of different HSIs or require a large amount of paired data for training, resulting in low reconstruction accuracy or poor generalization performance as well as interpretability. To remedy these deficiencies, this paper proposes a novel HSI reconstruction method, which exploits the global spectral correlation from the HSI itself through a formulation of model-driven low-rank subspace representation and learns the deep prior by a data-driven self-supervised deep learning scheme. Specifically, we firstly develop a model-driven low-rank subspace representation to decompose the HSI as the product of an orthogonal basis and a spatial representation coefficient, then propose a data-driven deep guided spatial-attention network (called DGSAN) to adaptively reconstruct the implicit spatial feature of HSI by learning the deep coefficient prior (DCP), and finally embed these implicit priors into an iterative optimization framework through a self-supervised training way without requiring any training data. Thus, the proposed method shall enhance the reconstruction accuracy, generalization ability, and interpretability. Extensive experiments on several datasets and imaging systems validate the superiority of our method. The source code and data of this article will be made publicly available at https://github.com/ChenYong1993/LRSDN.

DMDC: a cross-attention network for dynamic mask-based dual-camera snapshot hyperspectral Photography

DMDC: Dynamic-mask-based dual camera design for snapshot Hyperspectral Imaging

MLP-AMDC: An MLP Architecture for Adaptive-Mask-based Dual-Camera snapshot hyperspectral imaging

Deep-learning-based CASSI Reconstruction with Optical Aberration Correction

Snapshot Spectral Imaging Based on Aberration Model-Driven Deep Learning

Continuous Digital Zoom with Cross Attention for Dual Camera System

Deep Learning Enabled Reflective Coded Aperture Snapshot Spectral Imaging

Hyperspectral Compressive Snapshot Reconstruction via Coupled Low-Rank Subspace Representation and Self-Supervised Deep Network

Adaptive Nonlocal Sparse Representation for Dual-Camera Compressive Hyperspectral Imaging

Fast Parallel Implementation of Dual-Camera Compressive Hyperspectral Imaging System

A Snapshot Multi-Spectral Demosaicing Method for Multi-Spectral Filter Array Images Based on Channel Attention Network

Dual Camera Snapshot High-Resolution-hyperspectral Imaging System with Parallel Joint Optimization Via Physics-Informed Learning

Single-shot hyperspectral imaging based on dual attention neural network with multi-modal learning

A Mutually Boosting Dual Sensor Computational Camera for High Quality Dark Videography.

Coarse-Fine Spectral-Aware Deformable Convolution For Hyperspectral Image Reconstruction

A Dual Sensor Computational Camera for High Quality Dark Videography

Progressive Content-Aware Coded Hyperspectral Snapshot Compressive Imaging

Adaptive local sparse representation for compressive hyperspectral imaging

Hybrid Multi-Dimensional Attention U-Net for Hyperspectral Snapshot Compressive Imaging Reconstruction

Compressive Hyperspectral Imaging With Complementary Rgb Measurements

Deep-learning Enables Single-Pixel Spectral Imaging