Abstract:Requirements of compressed sensing techniques targeted at miniaturized hyperspectral satellite applications include lightweight onboard hardware, high-speed sensing, low sampling rate for compressing the massive volume of typical hyperspectral data, and noise robustness for reliable data transmission to the ground station. We achieve all these aims via deep learning, and neural networks resulted from which can be implemented on-chip, thereby allowing light hardware implementation. Our neural networks were trained from small-scaled data, but, even so, the resulting encoder achieves a very low sampling rate and very high speed. Unlike typical network training, the input–output pairs are not square but stripe-like images, partly because compressed acquisition does not allow performing compression after obtaining complete data cube and partly because stripe-like acquisition well matches the popular pushbroom hyperspectral sensing schemes. Even with such hard restriction caused by nontraditional training, the resulting decoder still reconstructs the image with high accuracy. To match the requirement of pushbroom sensing, a lightweight encoder is proposed to compress the stripe-like images immediately. Meanwhile, multiscale feature fusion block (MFB) and aggregation (MFA) modules are proposed to form our decoder for enhancing the feature representation of the compressed acquisitions. Furthermore, we achieve joint spatial/spectral super-resolution (SR) progressively, ensuring accurate hyperspectral reconstruction via a low-rank-driven decoder. The encoder and decoder are trained in an end-to-end manner, where noise robustness is forced during the training stage. Comprehensive experiments demonstrate the superiority of the proposed hyperspectral compressed sensing method, as well as its one-shot transfer learning (OTL)-based extension, both quantitatively and qualitatively.

Fast Nano-IR Hyperspectral Imaging Empowered by Large-Dataset-Free Miniaturized Spatial-Spectral Network

High-speed, High-Sensitivity Spectroscopic Stimulated Raman Scattering Microscopy by Ultrafast Delay-Line Tuning and Deep Learning

Alternative deep learning method for fast spatial-frequency shift imaging microscopy.

Untrained Neural Network Enabling Fast and Universal Structured-Illumination Microscopy

Convolutional Neural Network Based Computational Imaging Spectroscopy

Color Router-based Long-wave Infrared Multispectral Imaging

Fast non-iterative blind restoration of hyperspectral images with PSFs

SAR Fast Target Imaging in Sparse Field Based on AlexNet

Compressive Single-Pixel Hyperspectral Imaging Using RGB Sensors

Ultracompact Deep Neural Network for Ultrafast Optical Property Extraction in Spatial Frequency Domain Imaging (SFDI)

On-chip Real-time Hyperspectral Imager with Full CMOS Resolution Enabled by Massively Parallel Neural Network

Fast Multispectral Imaging by Spatial Pixel-Binning and Spectral Unmixing

Wide-field mid-infrared hyperspectral imaging beyond video rate

Rapid Infrared Spectroscopic Nanoimaging with nano-FTIR Holography

Single-shot hyperspectral imaging based on dual attention neural network with multi-modal learning

Fast Super-resolution 3D SAR Imaging Using an Unfolded Deep Network

DCSN: Deep Compressed Sensing Network for Efficient Hyperspectral Data Transmission of Miniaturized Satellite

Wide-Field, High-Resolution Reconstruction in Computational Multi-Aperture Miniscope Using a Fourier Neural Network

Dynamic single-photon 3D imaging with a sparsity-based neural network

Real-time X-ray Phase-contrast Imaging Using SPINNet -- A Speckle-based Phase-contrast Imaging Neural Network

Rapid and Extreme Low-light Superresolution Imaging Via Artificial Intelligence