Abstract:Coded Aperture Snapshot Spectral Imaging (CASSI) reconstruction aims to recover the 3D spatial-spectral signal from 2D measurement. Existing methods for reconstructing Hyperspectral Image (HSI) typically involve learning mappings from a 2D compressed image to a predetermined set of discrete spectral bands. However, this approach overlooks the inherent continuity of the spectral information. In this study, we propose an innovative method called Spectral-wise Implicit Neural Representation (SINR) as a pioneering step toward addressing this limitation. SINR introduces a continuous spectral amplification process for HSI reconstruction, enabling spectral super-resolution with customizable magnification factors. To achieve this, we leverage the concept of implicit neural representation. Specifically, our approach introduces a spectral-wise attention mechanism that treats individual channels as distinct tokens, thereby capturing global spectral dependencies. Additionally, our approach incorporates two components, namely a Fourier coordinate encoder and a spectral scale factor module. The Fourier coordinate encoder enhances the SINR's ability to emphasize high-frequency components, while the spectral scale factor module guides the SINR to adapt to the variable number of spectral channels. Notably, the SINR framework enhances the flexibility of CASSI reconstruction by accommodating an unlimited number of spectral bands in the desired output. Extensive experiments demonstrate that our SINR outperforms baseline methods. By enabling continuous reconstruction within the CASSI framework, we take the initial stride toward integrating implicit neural representation into the field.

Hyperspectral Image Reconstruction Via Patch Attention Driven Network

Deep-learning-based CASSI Reconstruction with Optical Aberration Correction

Snapshot Spectral Imaging Based on Aberration Model-Driven Deep Learning

Hyperspectral image recovery based on fusion of coded aperture snapshot spectral imaging and RGB images by guided filtering

Fast non-iterative blind restoration of hyperspectral images with PSFs

Spnet: A Spectral Patching Network For End-To-End Hyperspectral Image Classification

Hyperspectral Compressive Snapshot Reconstruction via Coupled Low-Rank Subspace Representation and Self-Supervised Deep Network

HyperReconNet: Joint Coded Aperture Optimization and Image Reconstruction for Compressive Hyperspectral Imaging.

DS PN: A Two-Stage Direction-Aware Spectral-Spatial Perceptual Network for Hyperspectral Image Reconstruction

Fast Hyperspectral Image Recovery via Non-iterative Fusion of Dual-Camera Compressive Hyperspectral Imaging

DS $^{2}$ PN: A Two-Stage Direction-Aware Spectral-Spatial Perceptual Network for Hyperspectral Image Reconstruction

Unsupervised Spatial-spectral Network Learning for Hyperspectral Compressive Snapshot Reconstruction

Coarse-Fine Spectral-Aware Deformable Convolution For Hyperspectral Image Reconstruction

Progressive Content-Aware Coded Hyperspectral Snapshot Compressive Imaging

Hyperspectral Image Reconstruction from RGB Input Through Highlighting Intrinsic Properties

Progressive Content-aware Coded Hyperspectral Compressive Imaging

Hyperspectral Image Super-Resolution with 1D-2D Attentional Convolutional Neural Network.

Spectral-wise Implicit Neural Representation for Hyperspectral Image Reconstruction

Hyperspectral Image Reconstruction Based on Improved Residual Dense Network

Adaptive local sparse representation for compressive hyperspectral imaging

Hyperspectral Image Reconstruction of SD-CASSI Based on Nonlocal Low-Rank Tensor Prior