Abstract:Hyperspectral imaging plays a pivotal role across diverse applications, like remote sensing, medicine, and cytology. The utilization of 2D sensors to acquire 3D hyperspectral images (HSIs) via a coded aperture snapshot spectral imaging (CASSI) system has proven successful, owing to its hardware-friendly implementation and fast sampling speed. Nevertheless, for less spectrally sparse scenes, the use of a single snapshot and unreasonable coded aperture design limits the efficacy of CASSI systems and renders HSI reconstruction more ill-posed, leading to compromised spatial and spectral fidelity. This paper proposes a novel Progressive Content-Aware CASSI (PCA-CASSI) framework, which progressively captures HSIs using multiple optimized content-aware coded apertures and fuses all snapshot measurements for reconstruction. By unlocking the full potential of CASSI systems and elevating their performance ceilings, this framework offers researchers new avenues for improving imaging quality. Furthermore, we develop the RndHRNet, a Range-Null space Decomposition (RND)-inspired deep unfolding network with multiple iterative phases for HSI recovery. Each unfolded recovery phase efficiently exploits the physical information within the coded apertures via explicit RND and adaptively explores the spatial-spectral correlation by dual transformer blocks. Through comprehensive experiments, our approach demonstrates superior performance compared to existing state-of-the-art methods in both the multiple- and single-shot compressive HSI imaging tasks with substantial improvements. Code is available at https://github.com/xuanyuzhang21/PCA-CASSI.

Multi-spectral compressive snapshot imaging using RGB image sensors

Compressive Single-Pixel Hyperspectral Imaging Using RGB Sensors

Simultaneous Coded Aperture and Dictionary Optimization in Compressive Spectral Imaging Via Coherence Minimization.

Hybrid Compressive Spectral Imaging with Coded Aperture Optimization Based on Coherence Minimization

Hyperspectral image recovery based on fusion of coded aperture snapshot spectral imaging and RGB images by guided filtering

Compressive Single-Pixel Spectral Imaging with Spatial-Spectral Modulation Optimization Via Coherence Minimization

Snapshot Compressive ToF+Spectral Imaging via Optimized Color-Coded Apertures

Development of Energy Correction Based Multishot Snapshot Spectral Imaging System

Single-pixel Multispectral Imaging Based on Macropixel Segmentation Method

Multispectral image compression by cluster-adaptive subspace representation

A Compact Compressive Hyperspectral Imaging System Based on Metasurface

Spatial-spectral Encoding and Dictionary Optimization in Compressive Single-Pixel Hyperspectral Imaging Based on Mutual Coherence Minimization

Convolutional Neural Network Based Computational Imaging Spectroscopy

Deep-learning Enables Single-Pixel Spectral Imaging

Adaptive local sparse representation for compressive hyperspectral imaging

Prior Image Guided Snapshot Compressive Spectral Imaging

Fast Hyperspectral Image Recovery via Non-iterative Fusion of Dual-Camera Compressive Hyperspectral Imaging

Progressive Content-Aware Coded Hyperspectral Snapshot Compressive Imaging

Compressive Spectral Imaging Via Misalignment Induced Equivalent Grayscale Coded Aperture

Multidimensional Compressed Sensing for Spectral Light Field Imaging

Compressive Hyperspectral Imaging with Side Information