Abstract:Coded Aperture Snapshot Spectral Imaging (CASSI) reconstruction aims to recover the 3D spatial-spectral signal from 2D measurement. Existing methods for reconstructing Hyperspectral Image (HSI) typically involve learning mappings from a 2D compressed image to a predetermined set of discrete spectral bands. However, this approach overlooks the inherent continuity of the spectral information. In this study, we propose an innovative method called Spectral-wise Implicit Neural Representation (SINR) as a pioneering step toward addressing this limitation. SINR introduces a continuous spectral amplification process for HSI reconstruction, enabling spectral super-resolution with customizable magnification factors. To achieve this, we leverage the concept of implicit neural representation. Specifically, our approach introduces a spectral-wise attention mechanism that treats individual channels as distinct tokens, thereby capturing global spectral dependencies. Additionally, our approach incorporates two components, namely a Fourier coordinate encoder and a spectral scale factor module. The Fourier coordinate encoder enhances the SINR's ability to emphasize high-frequency components, while the spectral scale factor module guides the SINR to adapt to the variable number of spectral channels. Notably, the SINR framework enhances the flexibility of CASSI reconstruction by accommodating an unlimited number of spectral bands in the desired output. Extensive experiments demonstrate that our SINR outperforms baseline methods. By enabling continuous reconstruction within the CASSI framework, we take the initial stride toward integrating implicit neural representation into the field.

HyperReconNet: Joint Coded Aperture Optimization and Image Reconstruction for Compressive Hyperspectral Imaging.

Hybrid Compressive Spectral Imaging with Coded Aperture Optimization Based on Coherence Minimization

Hyperspectral image recovery based on fusion of coded aperture snapshot spectral imaging and RGB images by guided filtering

Deep-learning-based CASSI Reconstruction with Optical Aberration Correction

Simultaneous Coded Aperture and Dictionary Optimization in Compressive Spectral Imaging Via Coherence Minimization.

Snapshot Spectral Imaging Based on Aberration Model-Driven Deep Learning

Convolutional Neural Network Based Computational Imaging Spectroscopy

Residual image recovery method based on the dual-camera design of a compressive hyperspectral imaging system

Progressive Content-aware Coded Hyperspectral Compressive Imaging

Hyperspectral Compressive Snapshot Reconstruction via Coupled Low-Rank Subspace Representation and Self-Supervised Deep Network

Progressive Content-Aware Coded Hyperspectral Snapshot Compressive Imaging

Hyperspectral Image Reconstruction Via Patch Attention Driven Network

Fast Hyperspectral Image Recovery via Non-iterative Fusion of Dual-Camera Compressive Hyperspectral Imaging

Adaptive local sparse representation for compressive hyperspectral imaging

Coarse-Fine Spectral-Aware Deformable Convolution For Hyperspectral Image Reconstruction

Coded Hyperspectral Image Reconstruction Using Deep External and Internal Learning

Compressive Hyperspectral Image Classification Using a 3D Coded Convolutional Neural Network

End to End Hyperspectral Imaging System with Coded Compression Imaging Process

Compressive spectral image classification using 3D coded convolutional neural network

Spectral-wise Implicit Neural Representation for Hyperspectral Image Reconstruction

Compressive Hyperspectral Imaging With Complementary Rgb Measurements