Abstract:The emerging technology of snapshot compressive imaging (SCI) enables capturing high dimensional (HD) data in an efficient way. It is generally implemented by two components: an optical encoder that compresses HD signals into a 2D measurement and an algorithm decoder that retrieves the HD data upon the hardware-encoded measurement. Over a broad range of SCI applications, hyperspectral imaging (HSI) and video compressive sensing have received significant research attention in recent years. Among existing SCI reconstruction algorithms, deep learning-based methods stand out as their promising performance and efficient inference. However, the deep reconstruction network may suffer from overlarge model size and highly-specialized network design, which inevitably lead to costly training time, high memory usage, and limited flexibility, thus discouraging the deployments of SCI systems in practical scenarios. In this paper, we tackle the above challenges by proposing a simple yet highly efficient reconstruction method, namely stacked residual network (SRN), by revisiting the residual learning strategy with nested structures and spatial-invariant property. The proposed SRN empowers high-fidelity data retrieval with fewer computation operations and negligible model size compared with existing networks, and also serves as a versatile backbone applicable for both hyperspectral and video data. Based on the proposed backbone, we first develop the channel attention enhanced SRN (CAE-SRN) to explore the spectral inter-dependencies for fine-grained spatial estimation in HSI. We then employ SRN as a deep denoiser and incorporate it into a generalized alternating projection (GAP) framework -- resulting in GAP-SRN -- to handle the video compressive sensing task. Experimental results demonstrate the state-of-the-art performance, high computational efficiency of the proposed SRN on two SCI applications.

RCUMP: Residual Completion Unrolling With Mixed Priors for Snapshot Compressive Imaging

Combining Low-Rank and Deep Plug-and-Play Priors for Snapshot Compressive Imaging

Dense Deep Unfolding Network with 3D-CNN Prior for Snapshot Compressive Imaging

Convolutional Neural Network Based Computational Imaging Spectroscopy

Unfolding Framework with Prior of Convolution-Transformer Mixture and Uncertainty Estimation for Video Snapshot Compressive Imaging

Efficient One-Step Diffusion Refinement for Snapshot Compressive Imaging

A Simple and Efficient Reconstruction Backbone for Snapshot Compressive Imaging

Untrained Neural Nets for Snapshot Compressive Imaging: Theory and Algorithms

Hyperspectral Compressive Snapshot Reconstruction via Coupled Low-Rank Subspace Representation and Self-Supervised Deep Network

Enhanced Deep Unrolling Networks for Snapshot Compressive Hyperspectral Imaging

Rank Minimization for Snapshot Compressive Imaging

Hybrid CNN-Transformer Architecture for Efficient Large-Scale Video Snapshot Compressive Imaging

Hyperspectral Image Reconstruction of SD-CASSI Based on Nonlocal Low-Rank Tensor Prior

Progressive Content-Aware Coded Hyperspectral Snapshot Compressive Imaging

Residual Degradation Learning Unfolding Framework with Mixing Priors across Spectral and Spatial for Compressive Spectral Imaging

Effective Snapshot Compressive-spectral Imaging via Deep Denoising and Total Variation Priors

Latent Diffusion Prior Enhanced Deep Unfolding for Snapshot Spectral Compressive Imaging

SCINeRF: Neural Radiance Fields from a Snapshot Compressive Image

Spatial-Temporal Synergic Prior Driven Unfolding Network for Snapshot Compressive Imaging

EfficientSCI: Densely Connected Network with Space-time Factorization for Large-scale Video Snapshot Compressive Imaging

DiffSCI: Zero-Shot Snapshot Compressive Imaging via Iterative Spectral Diffusion Model