Abstract:Coded Aperture Snapshot Spectral Imaging (CASSI) reconstruction aims to recover the 3D spatial-spectral signal from 2D measurement. Existing methods for reconstructing Hyperspectral Image (HSI) typically involve learning mappings from a 2D compressed image to a predetermined set of discrete spectral bands. However, this approach overlooks the inherent continuity of the spectral information. In this study, we propose an innovative method called Spectral-wise Implicit Neural Representation (SINR) as a pioneering step toward addressing this limitation. SINR introduces a continuous spectral amplification process for HSI reconstruction, enabling spectral super-resolution with customizable magnification factors. To achieve this, we leverage the concept of implicit neural representation. Specifically, our approach introduces a spectral-wise attention mechanism that treats individual channels as distinct tokens, thereby capturing global spectral dependencies. Additionally, our approach incorporates two components, namely a Fourier coordinate encoder and a spectral scale factor module. The Fourier coordinate encoder enhances the SINR's ability to emphasize high-frequency components, while the spectral scale factor module guides the SINR to adapt to the variable number of spectral channels. Notably, the SINR framework enhances the flexibility of CASSI reconstruction by accommodating an unlimited number of spectral bands in the desired output. Extensive experiments demonstrate that our SINR outperforms baseline methods. By enabling continuous reconstruction within the CASSI framework, we take the initial stride toward integrating implicit neural representation into the field.

Deep-learning-based CASSI Reconstruction with Optical Aberration Correction

Snapshot Spectral Imaging Based on Aberration Model-Driven Deep Learning

Hyperspectral image recovery based on fusion of coded aperture snapshot spectral imaging and RGB images by guided filtering

Hyperspectral Compressive Snapshot Reconstruction via Coupled Low-Rank Subspace Representation and Self-Supervised Deep Network

Development of Energy Correction Based Multishot Snapshot Spectral Imaging System

Hybrid Compressive Spectral Imaging with Coded Aperture Optimization Based on Coherence Minimization

Residual image recovery method based on the dual-camera design of a compressive hyperspectral imaging system

Simultaneous Coded Aperture and Dictionary Optimization in Compressive Spectral Imaging Via Coherence Minimization.

Adaptive Optics For Structured Illumination Microscopy Based On Deep Learning

High-Accuracy Image Formation Model for Coded Aperture Snapshot Spectral Imaging

Hyperspectral Image Reconstruction of SD-CASSI Based on Nonlocal Low-Rank Tensor Prior

A Fast Alternating Minimization Algorithm for Coded Aperture Snapshot Spectral Imaging Based on Sparsity and Deep Image Priors

Progressive Content-Aware Coded Hyperspectral Snapshot Compressive Imaging

Coarse-Fine Spectral-Aware Deformable Convolution For Hyperspectral Image Reconstruction

Progressive Content-aware Coded Hyperspectral Compressive Imaging

Spectral-wise Implicit Neural Representation for Hyperspectral Image Reconstruction

Adaptive local sparse representation for compressive hyperspectral imaging

An improved method based on twIst and dual-camera design for hyperspectral image reconstruction

DMDC: Dynamic-mask-based dual camera design for snapshot Hyperspectral Imaging

Fast Hyperspectral Image Recovery via Non-iterative Fusion of Dual-Camera Compressive Hyperspectral Imaging

DS PN: A Two-Stage Direction-Aware Spectral-Spatial Perceptual Network for Hyperspectral Image Reconstruction