Abstract:Hyperspectral imaging plays a pivotal role across diverse applications, like remote sensing, medicine, and cytology. The utilization of 2D sensors to acquire 3D hyperspectral images (HSIs) via a coded aperture snapshot spectral imaging (CASSI) system has proven successful, owing to its hardware-friendly implementation and fast sampling speed. Nevertheless, for less spectrally sparse scenes, the use of a single snapshot and unreasonable coded aperture design limits the efficacy of CASSI systems and renders HSI reconstruction more ill-posed, leading to compromised spatial and spectral fidelity. This paper proposes a novel Progressive Content-Aware CASSI (PCA-CASSI) framework, which progressively captures HSIs using multiple optimized content-aware coded apertures and fuses all snapshot measurements for reconstruction. By unlocking the full potential of CASSI systems and elevating their performance ceilings, this framework offers researchers new avenues for improving imaging quality. Furthermore, we develop the RndHRNet, a Range-Null space Decomposition (RND)-inspired deep unfolding network with multiple iterative phases for HSI recovery. Each unfolded recovery phase efficiently exploits the physical information within the coded apertures via explicit RND and adaptively explores the spatial-spectral correlation by dual transformer blocks. Through comprehensive experiments, our approach demonstrates superior performance compared to existing state-of-the-art methods in both the multiple- and single-shot compressive HSI imaging tasks with substantial improvements. Code is available at https://github.com/xuanyuzhang21/PCA-CASSI.

Development of Energy Correction Based Multishot Snapshot Spectral Imaging System

Snapshot Spectral Imaging Based on Aberration Model-Driven Deep Learning

Hyperspectral image recovery based on fusion of coded aperture snapshot spectral imaging and RGB images by guided filtering

Snapshot Hyperspectral Imaging Based on Equalization Designed DOE

Deep-learning-based CASSI Reconstruction with Optical Aberration Correction

Hybrid Compressive Spectral Imaging with Coded Aperture Optimization Based on Coherence Minimization

Simultaneous Coded Aperture and Dictionary Optimization in Compressive Spectral Imaging Via Coherence Minimization.

Multishot Hyperspectral Imaging Based on Tunable Diffractive Lenses

Compressive Single-Pixel Hyperspectral Imaging Using RGB Sensors

Residual image recovery method based on the dual-camera design of a compressive hyperspectral imaging system

Single-pixel Multispectral Imaging Based on Macropixel Segmentation Method

An improved method based on twIst and dual-camera design for hyperspectral image reconstruction

Progressive Content-Aware Coded Hyperspectral Snapshot Compressive Imaging

Efficient One-Step Diffusion Refinement for Snapshot Compressive Imaging

High-Accuracy Image Formation Model for Coded Aperture Snapshot Spectral Imaging

Aperture Diffraction for Compact Snapshot Spectral Imaging

Prior Image Guided Snapshot Compressive Spectral Imaging

Efficient Snapshot Spectral Imaging: Calibration-Free Parallel Structure with Aperture Diffraction Fusion

Fast Multispectral Imaging by Spatial Pixel-Binning and Spectral Unmixing

Real-Time Polarization Spectral Detection Based on a Dual-Dispersion and Coded-Aperture Imaging System.

Snapshot Hyperspectral Imaging Via Spectral Basis Multiplexing in Fourier Domain