Abstract:Computational photography has been striving to capture the spectral information of the dynamic world in the last few decades. However, due to the curse of dimensionality between the 3D spectral images and the 2D imaging sensors, light-blocking components, e.g., bandpass filters or coded apertures, have to be used in spectral imaging systems to project the 3D signal into 2D measurements selectively. Accordingly, computational reconstruction is integrated to recover the underlying 3D signal. Thus, these systems suffer from low light efficiency and high computational burden, both of which cannot afford dynamic spectral imaging. In this paper, we propose a novel snapshot spectral imaging system that can dynamically capture the spectral images. The system is composed of a lens array, a notch filter array, and a monochrome camera in principle. Incoming light beams from the scene are spatially multiplexed by the lens array, spectrally mixed by the notch filter array, and captured by the monochrome camera. The two distinct characteristics, i.e., spatial multiplexing and spectral mixing, guarantee the advantages of low computational burden and high light efficiency, respectively. We further build a prototype system according to the imaging principles. The system can record two kinds of images in a single snapshot: bandstop multispectral images and a panchromatic image, which are used jointly to recover the bandpass multispectral images at few computational costs. Moreover, the proposed system is friendly with spectral super-resolution, for which we develop a theoretical demonstration. Both simulations and experiments are conducted to verify the effectiveness of the proposed system.

Handheld Snapshot Multi-spectral Camera at 65-Megapixel Resolution

Handheld snapshot multi-spectral camera at tens-of-megapixel resolution

Deeply Learned Broadband Encoding Stochastic Hyperspectral Imaging.

Compressive Single-Pixel Hyperspectral Imaging Using RGB Sensors

Snapshot Hyperspectral Volumetric Microscopy

Fast Multispectral Imaging by Spatial Pixel-Binning and Spectral Unmixing

High Light Efficiency Snapshot Spectral Imaging Via Spatial Multiplexing and Spectral Mixing.

Portable Multi-Spectral Lens-Less Microscope with Wavelength-Self-calibrating Imaging Sensor

High resolution multispectral video capture with a hybrid camera system

SpectraTrack: Megapixel, Hundred-Fps, and Thousand-Channel Hyperspectral Imaging

Experimental Demonstration of an Anti-Shake Hyperspectral Imager of High Spatial Resolution and Low Cost

Wide-field mid-infrared hyperspectral imaging beyond video rate

A Stare-Down Video-Rate High-Throughput Hyperspectral Imaging System and Its Applications in Biological Sample Sensing

A broadband hyperspectral image sensor with high spatio-temporal resolution

A light-efficient and versatile multiplexing method for snapshot spectral imaging

High-resolution Spectral Video Acquisition

High cost-efficient and computational gigapixel video camera based on commercial lenses and CMOS chips.

High-resolution Multispectral Imaging Using a Photodiode

SpectralZoom: Efficient Segmentation with an Adaptive Hyperspectral Camera

High-speed Hyperspectral Video Acquisition with a Dual-Camera Architecture.

Snapshot Hyperspectral Imaging Via Spectral Basis Multiplexing in Fourier Domain