Abstract:Hyperspectral imaging plays a pivotal role across diverse applications, like remote sensing, medicine, and cytology. The utilization of 2D sensors to acquire 3D hyperspectral images (HSIs) via a coded aperture snapshot spectral imaging (CASSI) system has proven successful, owing to its hardware-friendly implementation and fast sampling speed. Nevertheless, for less spectrally sparse scenes, the use of a single snapshot and unreasonable coded aperture design limits the efficacy of CASSI systems and renders HSI reconstruction more ill-posed, leading to compromised spatial and spectral fidelity. This paper proposes a novel Progressive Content-Aware CASSI (PCA-CASSI) framework, which progressively captures HSIs using multiple optimized content-aware coded apertures and fuses all snapshot measurements for reconstruction. By unlocking the full potential of CASSI systems and elevating their performance ceilings, this framework offers researchers new avenues for improving imaging quality. Furthermore, we develop the RndHRNet, a Range-Null space Decomposition (RND)-inspired deep unfolding network with multiple iterative phases for HSI recovery. Each unfolded recovery phase efficiently exploits the physical information within the coded apertures via explicit RND and adaptively explores the spatial-spectral correlation by dual transformer blocks. Through comprehensive experiments, our approach demonstrates superior performance compared to existing state-of-the-art methods in both the multiple- and single-shot compressive HSI imaging tasks with substantial improvements. Code is available at https://github.com/xuanyuzhang21/PCA-CASSI.

Deep-learning Enables Single-Pixel Spectral Imaging

Spectral Imaging with Deep Learning.

Compressive Single-Pixel Hyperspectral Imaging Using RGB Sensors

Hybrid Compressive Spectral Imaging with Coded Aperture Optimization Based on Coherence Minimization

Deeply Learned Broadband Encoding Stochastic Hyperspectral Imaging.

Simultaneous Coded Aperture and Dictionary Optimization in Compressive Spectral Imaging Via Coherence Minimization.

Convolutional Neural Network Based Computational Imaging Spectroscopy

Snapshot Spectral Imaging Based on Aberration Model-Driven Deep Learning

Deep-learning-based CASSI Reconstruction with Optical Aberration Correction

Deep Learning Enabled Reflective Coded Aperture Snapshot Spectral Imaging

Spatial-spectral Encoding and Dictionary Optimization in Compressive Single-Pixel Hyperspectral Imaging Based on Mutual Coherence Minimization

Compact Colorful Compressive Spectral Imager Based on Deep Learning Reconstruction

Spectral-depth imaging with deep learning based reconstruction.

Double-channel compressive spectral imaging via complementary code patterns

Compressive Hyperspectral Imaging With Complementary Rgb Measurements

Compressive Hyperspectral Imaging And Super-Resolution

Computational Spectral-Depth Imaging with a Compact System.

Depth Acquisition in Single-Pixel Imaging with Multiplexed Illumination

Progressive Content-Aware Coded Hyperspectral Snapshot Compressive Imaging

Multi-spectral compressive snapshot imaging using RGB image sensors

Deep-learning-based Single-Photon-counting Compressive Imaging Via Jointly Trained Subpixel Convolution Sampling.