Abstract:Hyperspectral imaging plays a pivotal role across diverse applications, like remote sensing, medicine, and cytology. The utilization of 2D sensors to acquire 3D hyperspectral images (HSIs) via a coded aperture snapshot spectral imaging (CASSI) system has proven successful, owing to its hardware-friendly implementation and fast sampling speed. Nevertheless, for less spectrally sparse scenes, the use of a single snapshot and unreasonable coded aperture design limits the efficacy of CASSI systems and renders HSI reconstruction more ill-posed, leading to compromised spatial and spectral fidelity. This paper proposes a novel Progressive Content-Aware CASSI (PCA-CASSI) framework, which progressively captures HSIs using multiple optimized content-aware coded apertures and fuses all snapshot measurements for reconstruction. By unlocking the full potential of CASSI systems and elevating their performance ceilings, this framework offers researchers new avenues for improving imaging quality. Furthermore, we develop the RndHRNet, a Range-Null space Decomposition (RND)-inspired deep unfolding network with multiple iterative phases for HSI recovery. Each unfolded recovery phase efficiently exploits the physical information within the coded apertures via explicit RND and adaptively explores the spatial-spectral correlation by dual transformer blocks. Through comprehensive experiments, our approach demonstrates superior performance compared to existing state-of-the-art methods in both the multiple- and single-shot compressive HSI imaging tasks with substantial improvements. Code is available at https://github.com/xuanyuzhang21/PCA-CASSI.

Dataset for 10-Mega Pixel Snapshot Compressive Imaging with a Hybrid Coded Aperture

10-mega pixel snapshot compressive imaging with a hybrid coded aperture

Ten-mega-pixel snapshot compressive imaging with a hybrid coded aperture

Hybrid Compressive Spectral Imaging with Coded Aperture Optimization Based on Coherence Minimization

Spatial-spectral Encoding and Dictionary Optimization in Compressive Single-Pixel Hyperspectral Imaging Based on Mutual Coherence Minimization

Simultaneous Coded Aperture and Dictionary Optimization in Compressive Spectral Imaging Via Coherence Minimization.

Compressive Single-Pixel Hyperspectral Imaging Using RGB Sensors

SASA: Saliency-Aware Self-Adaptive Snapshot Compressive Imaging

Snapshot Compressive Imaging: Principle, Implementation, Theory, Algorithms and Applications

Progressive Content-Aware Coded Hyperspectral Snapshot Compressive Imaging

Plug-and-Play Algorithms for Large-scale Snapshot Compressive Imaging

Design of on-chip coded high-resolution 2D imaging via 3D compressed sensing

Optimization Of Compressive 4d-Spatio-Spectral Snapshot Imaging

An Encoded Photodetector Array for High-frame-rate Compressed Sensing and Computational Imaging

Snapshot Interferometric 3D Imaging by Compressive Sensing and Deep Learning

Coded Aperture Compression Temporal Imaging Based on a Dual-Mask and Deep Denoiser

Shearlet Enhanced Snapshot Compressive Imaging

Deep Optics for Video Snapshot Compressive Imaging

GAP-net for Snapshot Compressive Imaging

Snapshot Compressive ToF+Spectral Imaging via Optimized Color-Coded Apertures

Progressive Content-aware Coded Hyperspectral Compressive Imaging