Abstract:Multispectral imaging has been used for numerous applications in e.g., environmental monitoring, aerospace, defense, and biomedicine. Here, we present a diffractive optical network-based multispectral imaging system trained using deep learning to create a virtual spectral filter array at the output image field-of-view. This diffractive multispectral imager performs spatially-coherent imaging over a large spectrum, and at the same time, routes a pre-determined set of spectral channels onto an array of pixels at the output plane, converting a monochrome focal plane array or image sensor into a multispectral imaging device without any spectral filters or image recovery algorithms. Furthermore, the spectral responsivity of this diffractive multispectral imager is not sensitive to input polarization states. Through numerical simulations, we present different diffractive network designs that achieve snapshot multispectral imaging with 4, 9 and 16 unique spectral bands within the visible spectrum, based on passive spatially-structured diffractive surfaces, with a compact design that axially spans ~72 times the mean wavelength of the spectral band of interest. Moreover, we experimentally demonstrate a diffractive multispectral imager based on a 3D-printed diffractive network that creates at its output image plane a spatially-repeating virtual spectral filter array with 2x2=4 unique bands at terahertz spectrum. Due to their compact form factor and computation-free, power-efficient and polarization-insensitive forward operation, diffractive multispectral imagers can be transformative for various imaging and sensing applications and be used at different parts of the electromagnetic spectrum where high-density and wide-area multispectral pixel arrays are not widely available.

Snapshot Multispectral Light-Field Imaging Based on Nematic Liquid-Crystal Microlens Array via Deep Learning

Color Router-based Long-wave Infrared Multispectral Imaging

Snapshot Spectral Imaging Based on Aberration Model-Driven Deep Learning

Portable Multi-Spectral Lens-Less Microscope with Wavelength-Self-calibrating Imaging Sensor

Light Field Imaging Based on Electrically Tunable Nematic Liquid Crystal Micro Lens Array

High-resolution light field imaging based on liquid crytal microlens arrays with ZnO microstructure orientation

A Snapshot Light Field Imaging Spectrometer

All-day Thin-Lens Computational Imaging with Scene-Specific Learning Recovery

Data rectification and decoding of a microlens array-based multi-spectral light field imaging system

Snapshot Hyperspectral Light Field Imaging

Resolution Improvement of Light Field Imaging via a Nematic Liquid Crystal Microlens with Added Multi-Walled Carbon Nanotubes

Ultra-compact snapshot spectral light-field imaging

Snapshot Multispectral Imaging Using a Diffractive Optical Network

Learned liquid crystal microlens array for joint optimized deep optical architecture in identifying metameric materials

High-Accuracy Depth Estimation of Nematic Liquid Crystal Microlens Arrays Based on Convex Optimization Theory

Realisation of an Application Specific Multispectral Snapshot-Imaging System Based on Multi-Aperture-Technology and Multispectral Machine Learning Loops

High-Quality Light Field Microscope Imaging Based on Microlens Arrays

Low-cost, High-Speed Multispectral Imager Via Spatiotemporal Modulation Based on a Color Camera.

Multispectral Imaging with Fresnel Lens

Dual-polarized light-field imaging micro-system via a liquid-crystal microlens array for direct three-dimensional observation.

High Light Efficiency Snapshot Spectral Imaging Via Spatial Multiplexing and Spectral Mixing.