Abstract:Snapshot compressive imaging (SCI) is a promising technique that captures a 3-D hyperspectral image (HSI) by a 2-D detector in a compressed manner. The ill-posed inverse process of reconstructing the HSI from their corresponding 2-D measurements is challenging. However, current approaches either neglect the underlying characteristics, such as high spectral correlation, or demand abundant training datasets, resulting in an inadequate balance among performance, generalizability, and interpretability. To address these challenges, in this article, we propose a novel approach called LR2DP that integrates the model-driven low-rank prior and data-driven deep priors for SCI reconstruction. This approach not only captures the spectral correlation and deep spatial features of HSI but also takes advantage of both model-based and learning-based methods without requiring any extra training datasets. Specifically, to preserve the strong spectral correlation of the HSI effectively, we propose that the HSI lies in a low-rank subspace, thereby transforming the problem of reconstructing the HSI into estimating the spectral basis and spatial representation coefficient. Inspired by the mutual promotion of unsupervised deep image prior (DIP) and trained deep denoising prior (DDP), we integrate the unsupervised network and pre-trained deep denoiser into the plug-and-play (PnP) regime to estimate the representation coefficient together, aiming to explore the internal target image prior (learned by DIP) and the external training image prior (depicted by pre-trained DDP) of the HSI. An effective half-quadratic splitting (HQS) technique is employed to optimize the proposed HSI reconstruction model. Extensive experiments on both simulated and real datasets demonstrate the superiority of the proposed method over the state-of-the-art approaches.

GAPMSF-Net: Generalized Alternating Projection With Multi-Stage Fusion Network for Snapshot Compressive Imaging

GAP-net for Snapshot Compressive Imaging

EiCSNet: Efficient Iterative Neural Network for Compressed Sensing Reconstruction

Dense Deep Unfolding Network with 3D-CNN Prior for Snapshot Compressive Imaging

Spatial-Temporal Synergic Prior Driven Unfolding Network for Snapshot Compressive Imaging

EfficientSCI: Densely Connected Network with Space-time Factorization for Large-scale Video Snapshot Compressive Imaging

Plug-and-Play Algorithms for Large-scale Snapshot Compressive Imaging

Plug-and-Play Algorithms for Video Snapshot Compressive Imaging

Hybrid CNN-Transformer Architecture for Efficient Large-Scale Video Snapshot Compressive Imaging

SCIGS: 3D Gaussians Splatting from a Snapshot Compressive Image

Deep learning for video compressive sensing

MetaSCI: Scalable and Adaptive Reconstruction for Video Compressive Sensing

Deep Optics for Video Snapshot Compressive Imaging

Unfolding Framework with Prior of Convolution-Transformer Mixture and Uncertainty Estimation for Video Snapshot Compressive Imaging

Memory-Efficient Network for Large-scale Video Compressive Sensing

Deep Motion Regularizer for Video Snapshot Compressive Imaging

Untrained Neural Nets for Snapshot Compressive Imaging: Theory and Algorithms

Spectral Compressive Imaging Reconstruction Using Convolution and Contextual Transformer

Combining Low-Rank and Deep Plug-and-Play Priors for Snapshot Compressive Imaging

Key Frames Assisted Hybrid Encoding for High-Quality Compressive Video Sensing

10-mega pixel snapshot compressive imaging with a hybrid coded aperture