Abstract:Hyperspectral imaging provides optical information with high-dimensional spatial-temporal-spectral data cubes revealing intrinsic matter characteristics. It has been widely applied in various intelligent inspection applications. The existing hyperspectral imaging systems employ individual optical prism or grating to separate different spectra, which require complicated optical design that takes a heavy load for integration. The emerging multispectral imaging sensor integrates narrow-band filters on each pixel element, wasting most light throughput and trapped in the rigorous tradeoff between spatial and spectral resolution. In this work, we report an on-chip computational hyperspectral imaging framework with full spatial and temporal resolution. By integrating different broadband filtering materials on the imaging sensor, the target spectral information is non-uniformly and intrinsically coupled on each pixel with high light throughput. Using intelligent reconstruction algorithms, multi-channel images can be recovered from each frame, realizing real-time hyperspectral imaging. Following such a framework, we for the first time fabricated a broadband (400-1700 nm) hyperspectral imaging sensor with an average light throughput of 71.8$\%$ (enabling 32.5 dB peak signal-to-noise ratio of spectral reconstruction on ColorChecker Classic chart) and 89 wavelength channels (10 nm interval within 400-1000 nm and 25 nm interval within 1000-1700 nm). The average spectral resolution achieves 2.65 nm at 400-1000 nm and 8.59 nm at 1000-1700 nm. The demonstrated spatial resolution is 2048x2048 pixels at 47 fps, with $\sim$3.43 arc minute resolving ability at a 39-degree field of view. We employed the prototype sensor to collect a large-scale hyperspectral image dataset (210 scenes over 8 categories), and demonstrated the sensor's wide application potentials on a series of experiments ...

A direct comparison of a next generation hyperspectral camera to state-of-the-art

Compressive Single-Pixel Hyperspectral Imaging Using RGB Sensors

Deeply Learned Broadband Encoding Stochastic Hyperspectral Imaging.

Colour Matching Comparison Between Spectrophotometric and Multispectral Imaging Measurements

Performance comparison of COTS-based hyperspectral imagers using detailed point spread function measurements

A low-cost integrated hyperspectral imaging sensor with full temporal and spatial resolution at VIS-NIR wide range

A Single Sensor Based Multispectral Imaging Camera using a Narrow Spectral Band Colour Mosaic Integrated on the Monochrome CMOS Image Sensor

A single sensor based multispectral imaging camera using a narrow spectral band color mosaic integrated on the monochrome CMOS image sensor

High-Resolution Hyperspectral Video Imaging Using A Hexagonal Camera Array

Synchronising an IMX219 image sensor and AS7265x spectral sensor to make a novel low-cost spectral camera

On-chip Real-time Hyperspectral Imager with Full CMOS Resolution Enabled by Massively Parallel Neural Network

Active and Low-Cost Hyperspectral Imaging for the Spectral Analysis of a Low-Light Environment

Content-adaptive high-resolution hyperspectral video acquisition with a hybrid camera system.

Scientific CMOS sensors in Astronomy: IMX455 and IMX411

Low-cost, High-Speed Multispectral Imager Via Spatiotemporal Modulation Based on a Color Camera.

A light-efficient and versatile multiplexing method for snapshot spectral imaging

Comparative Performance Studies Between Tunable Filter And Pushbroom Chemical Imaging Systems

The Instrument Design of Lightweight and Large Field of View High-Resolution Hyperspectral Camera

An Airborne Multispectral Imaging System Based on Two Consumer-Grade Cameras for Agricultural Remote Sensing

DUAL-MODE HYPERSPECTRAL BIO-IMAGER WITH A CONJUGATED CAMERA FOR QUICK OBJECT-SELECTION AND FOCUSING

High-resolution Spectral Video Acquisition