Abstract:Hyperspectral imaging provides optical information with high-dimensional spatial-temporal-spectral data cubes revealing intrinsic matter characteristics. It has been widely applied in various intelligent inspection applications. The existing hyperspectral imaging systems employ individual optical prism or grating to separate different spectra, which require complicated optical design that takes a heavy load for integration. The emerging multispectral imaging sensor integrates narrow-band filters on each pixel element, wasting most light throughput and trapped in the rigorous tradeoff between spatial and spectral resolution. In this work, we report an on-chip computational hyperspectral imaging framework with full spatial and temporal resolution. By integrating different broadband filtering materials on the imaging sensor, the target spectral information is non-uniformly and intrinsically coupled on each pixel with high light throughput. Using intelligent reconstruction algorithms, multi-channel images can be recovered from each frame, realizing real-time hyperspectral imaging. Following such a framework, we for the first time fabricated a broadband (400-1700 nm) hyperspectral imaging sensor with an average light throughput of 71.8$\%$ (enabling 32.5 dB peak signal-to-noise ratio of spectral reconstruction on ColorChecker Classic chart) and 89 wavelength channels (10 nm interval within 400-1000 nm and 25 nm interval within 1000-1700 nm). The average spectral resolution achieves 2.65 nm at 400-1000 nm and 8.59 nm at 1000-1700 nm. The demonstrated spatial resolution is 2048x2048 pixels at 47 fps, with $\sim$3.43 arc minute resolving ability at a 39-degree field of view. We employed the prototype sensor to collect a large-scale hyperspectral image dataset (210 scenes over 8 categories), and demonstrated the sensor's wide application potentials on a series of experiments ...

Towards Ultra High-Speed Hyperspectral Imaging by Integrating Compressive and Neuromorphic Sampling

Compressive Single-Pixel Hyperspectral Imaging Using RGB Sensors

High-Speed Hyperspectral Video Acquisition by Combining Nyquist and Compressive Sampling

Deeply Learned Broadband Encoding Stochastic Hyperspectral Imaging.

Fast Multispectral Imaging by Spatial Pixel-Binning and Spectral Unmixing

NeuSpike-Net: High Speed Video Reconstruction via Bio-inspired Neuromorphic Cameras

High-speed Hyperspectral Video Acquisition with a Dual-Camera Architecture.

Ultra-high Temporal Resolution Visual Reconstruction from a Fovea-like Spike Camera via Spiking Neuron Model

High-speed Real-Time Single-Pixel Microscopy Based on Fourier Sampling

Fast hyperspectral single-pixel imaging via frequency-division multiplexed illumination

Snapshot Hyperspectral Imaging Via Spectral Basis Multiplexing in Fourier Domain

Wide-field mid-infrared hyperspectral imaging beyond video rate

Capture the Moment: High-Speed Imaging With Spiking Cameras Through Short-Term Plasticity

Single-shot hyperspectral imaging based on dual attention neural network with multi-modal learning

Pix2HDR -- A pixel-wise acquisition and deep learning-based synthesis approach for high-speed HDR videos

10-mega pixel snapshot compressive imaging with a hybrid coded aperture

High resolution multispectral video capture with a hybrid camera system

Sinusoidal Sampling Enhanced Compressive Camera for High Speed Imaging

High-speed Image Reconstruction through Short-term Plasticity for Spiking Cameras

Recognizing Ultra-High-Speed Moving Objects with Bio-Inspired Spike Camera

A low-cost integrated hyperspectral imaging sensor with full temporal and spatial resolution at VIS-NIR wide range