Abstract:Computational photography has been striving to capture the spectral information of the dynamic world in the last few decades. However, due to the curse of dimensionality between the 3D spectral images and the 2D imaging sensors, light-blocking components, e.g., bandpass filters or coded apertures, have to be used in spectral imaging systems to project the 3D signal into 2D measurements selectively. Accordingly, computational reconstruction is integrated to recover the underlying 3D signal. Thus, these systems suffer from low light efficiency and high computational burden, both of which cannot afford dynamic spectral imaging. In this paper, we propose a novel snapshot spectral imaging system that can dynamically capture the spectral images. The system is composed of a lens array, a notch filter array, and a monochrome camera in principle. Incoming light beams from the scene are spatially multiplexed by the lens array, spectrally mixed by the notch filter array, and captured by the monochrome camera. The two distinct characteristics, i.e., spatial multiplexing and spectral mixing, guarantee the advantages of low computational burden and high light efficiency, respectively. We further build a prototype system according to the imaging principles. The system can record two kinds of images in a single snapshot: bandstop multispectral images and a panchromatic image, which are used jointly to recover the bandpass multispectral images at few computational costs. Moreover, the proposed system is friendly with spectral super-resolution, for which we develop a theoretical demonstration. Both simulations and experiments are conducted to verify the effectiveness of the proposed system.

Computational Snapshot Multispectral Cameras: Toward dynamic capture of the spectral world.

Compressive Single-Pixel Hyperspectral Imaging Using RGB Sensors

Deeply Learned Broadband Encoding Stochastic Hyperspectral Imaging.

Convolutional Neural Network Based Computational Imaging Spectroscopy

Single-pixel Multispectral Imaging Based on Macropixel Segmentation Method

Color Router-based Long-wave Infrared Multispectral Imaging

Fast Multispectral Imaging by Spatial Pixel-Binning and Spectral Unmixing

Snapshot Hyperspectral Imaging Via Spectral Basis Multiplexing in Fourier Domain

The Development of Snapshot Multispectral Imaging Technology Based on Artificial Compound Eyes

High Light Efficiency Snapshot Spectral Imaging Via Spatial Multiplexing and Spectral Mixing.

Handheld Snapshot Multi-spectral Camera at 65-Megapixel Resolution

Snapshot Hyperspectral Volumetric Microscopy

A light-efficient and versatile multiplexing method for snapshot spectral imaging

Learning based compressive snapshot spectral light field imaging with RGB sensors

Multidimensional Compressive Optical Microscopy

Single-shot multispectral imaging with a monochromatic camera

High-Fidelity Hyperspectral Snapshot of Physical World: System Architecture, Dataset and Model

Handheld snapshot multi-spectral camera at tens-of-megapixel resolution

Multispectral Focal Stack Acquisition Using A Chromatic Aberration Enlarged Camera

Compressive Imaging and Spectroscopy – Beyond the Single Pixel Camera

Snapshot spectral imaging: from spatial-spectral mapping to metasurface-based imaging