Abstract:Computational imaging spectrometry provides spatial-spectral information of objects. This technology has been applied in biomedical imaging, ocean monitoring, military and geographical object identification, etc. Via compressive sensing with coded apertures, 3D spatial-spectral data cube of hyperspectral image is compressed into 2D data array to alleviate the problems due to huge amounts of data. In this paper, a 3D convolutional neural network (3D CNN) is proposed for reconstruction of compressively sensed (CS) multispectral image. This network takes the 2D compressed data as the input and gives an intermediate output, which has identical size with the original 3D data. Then a general image denoiser is applied on it to obtain the final reconstruction result. The network with one fully connected layer, six 3D convolutional layers is trained with a standard hyperspectral image dataset. Though the compression rate is extremely high (16: 1), this network performs well both in spectral reconstruction, demonstrated with single point spectrum, and in quantitative comparison with original data, in terms of peak signal to noise ratio (PSNR). Compared with state-of-the-art iterative reconstruction methods e.g. two-step iterative shrinkage/thresholding (TwIST), this network features high speed reconstruction and low spectral dispersion, which potentially guarantees more accurate identification of objects.

Image Compressed Sensing Reconstruction with 3D Transform Domain Collaborative Filtering

Image Reconstruction Via Small Block-Based Compressed Sensing and Discrete Legendre Polynomials

Compressed Sensing Fourier Single Pixel Imaging Algorithm Based on Joint Discrete Gradient and Non-Local Self-Similarity Priors

Convolutional Neural Network Based Computational Imaging Spectroscopy

The algorithm of image representation and reconstruction based on compressed sensing with composite measurement

Image Reconstruction Algorithm of Compressed Sensing Based on Nonlocal Similarity Model

The Study of Image Reconstruction Based on Compressed Sensing Theory

An Iterative Weighing Algorithm for Image Reconstruction in Compressive Sensing

Image Compressed Sensing Reconstruction By Collaborative Use Of Statistical And Structural Priors

Hyperspectral Imaging Via Three-dimensional Compressed Sampling

Downward Spatially-Scalable Image Reconstruction Based on Compressed Sensing

Spatially Adaptive Image Reconstruction Via Compressive Sensing

Image Reconstruction Algorithm from Compressed Sensing Measurements by Dictionary Learning

TransCS: A Transformer-Based Hybrid Architecture for Image Compressed Sensing

Compressed Sensing Image Reconstruction Based On Joint Statistical And Structural Priors

Image Compressive Sensing Recovery Via Collaborative Sparsity

Compressed Sensing Reconstruction Of Hyperspectral Images Jointly Using Spatial Smoothing Feature And Spectral Correlation

Compressed Sensing by Collaborative Reconstruction on Overcomplete Dictionary

Image Reconstruction Based on Sub-Gaussian Random Projection

Spatial-spectral compressive sensing of hyperspectral image

Compressed Sensing Image Reconstruction with Fast Convolution Filtering