Abstract:Multispectral imaging system is of wide application in relevant fields for its capability in acquiring spectral information of scenes. Its limitation is that, due to the large number of spectral channels, the imaging process can be quite time-consuming when capturing high-resolution (HR) multispectral images. To resolve this limitation, this paper proposes a fast multispectral imaging framework based on the image sensor pixel-binning and spectral unmixing techniques. The framework comprises a fast imaging stage and a computational reconstruction stage. In the imaging stage, only a few spectral images are acquired in HR, while most spectral images are acquired in low resolution (LR). The LR images are captured by applying pixel binning on the image sensor, such that the exposure time can be greatly reduced. In the reconstruction stage, an optimal number of basis spectra are computed and the signal-dependent noise statistics are estimated. Then the unknown HR images are efficiently reconstructed by solving a closed-form cost function that models the spatial and spectral degradations. The effectiveness of the proposed framework is evaluated using real-scene multispectral images. Experimental results validate that, in general, the method outperforms the state of the arts in terms of reconstruction accuracy, with additional $20\times $ or more improvement in computational efficiency.

Ultra-high-speed four-dimensional hyperspectral imaging

Spectral Imaging with Deep Learning.

Deeply Learned Broadband Encoding Stochastic Hyperspectral Imaging.

4-K-resolution Minimalist Optical System Design Based on Deep Learning.

Compressive Single-Pixel Hyperspectral Imaging Using RGB Sensors

Fabry-Perot Multilayer for Spectral Imaging Applications

Spectral-depth imaging with deep learning based reconstruction.

Wide-field mid-infrared hyperspectral imaging beyond video rate

Deep-learning Enables Single-Pixel Spectral Imaging

Deep learning-enhanced snapshot hyperspectral confocal microscopy imaging system

Ultra-compact snapshot spectral light-field imaging

Fast Multispectral Imaging by Spatial Pixel-Binning and Spectral Unmixing

High-precision four-dimensional hyperspectral imager integrating fluorescence spectral detection and 3D surface shape measurement

4D Surface Shape Measurement System with High Spectral Resolution and Great Depth Accuracy.

Ultra-Compact Computed Tomography Snapshot Spectral Light-Field Imaging Based on Parallelized Metasurfaces

Real-time machine learning-enhanced hyperspectro-polarimetric imaging via an encoding metasurface

Towards Ultra High-Speed Hyperspectral Imaging by Integrating Compressive and Neuromorphic Sampling

PORTABLE 4D SNAPSHOT HYPERSPECTRAL IMAGER FOR FASTSPECTRAL AND SURFACE MORPHOLOGY MEASUREMENTS

Hyperspectral Computational Ghost Imaging Via Temporal Multiplexing

Fast hyperspectral single-pixel imaging via frequency-division multiplexed illumination

Ultrafast Three-Dimensional Surface Imaging Based on Short-Time Fourier Transform