Abstract:Spectral imaging technology, which aims to capture images across multiple spectral channels and create a spectral data cube, has been widely utilized in various fields. However, conventional spectral imaging systems face challenges, such as slow acquisition speed and large size. The rapid development of optical metasurfaces, capable of manipulating light fields versatilely and miniaturizing optical components into ultrathin planar devices, offers a promising solution for compact hyperspectral imaging (HSI). This study proposes a compact snapshot compressive spectral imaging (SCSI) system by leveraging the spectral modulations of metasurfaces with dual-channel switchable metasurface filters and employing a deep-learning-based reconstruction algorithm. To achieve compactness, the proposed system integrates dual-channel switchable metasurface filters using twisted nematic liquid crystals (TNLCs) and anisotropic titanium dioxide (TiO2) nanostructures. These thin metasurface filters are closely attached to the image sensor, resulting in a compact system. The TNLCs possess a broadband linear polarization conversion ability, enabling the rapid switching of the incidence polarization state between x-polarization and y-polarization by applying different voltages. This polarization conversion facilitates the generation of two groups of transmittance spectra for wavelength-encoding, providing richer information for spectral data cube reconstruction compared to that of other snapshot compressive spectral imaging techniques. In addition, instead of employing classic iterative compressive sensing (CS) algorithms, an end-to-end residual neural network (ResNet) is utilized to reconstruct the spectral data cube. This neural network leverages the 2-frame snapshot measurements of orthogonal polarization channels. The proposed hyperspectral imaging technology demonstrates superior reconstruction quality and speed compared to those of the traditional compressive hyperspectral image recovery methods. As a result, it is expected that this technology will have substantial implications in various domains, including but not limited to object detection, face recognition, food safety, biomedical imaging, agriculture surveillance, and so on.

Ultra-Compact Computed Tomography Snapshot Spectral Light-Field Imaging Based on Parallelized Metasurfaces

A Compact Compressive Hyperspectral Imaging System Based on Metasurface

Spectral Imaging with Deep Learning.

Ultra-compact snapshot spectral light-field imaging

Ultra-deep three-dimensional optical coherence tomography in turbid media

Snapshot spectral imaging: from spatial-spectral mapping to metasurface-based imaging

Dual-Channel Switchable Metasurface Filters for Compact Spectral Imaging with Deep Compressive Reconstruction

Snapshot hyperspectral light field tomography

Ultrafast light field tomography for snapshot transient and non-line-of-sight imaging

One-shot ultraspectral imaging with reconfigurable metasurfaces

Metasurface-empowered snapshot hyperspectral imaging with convex/deep (CODE) small-data learning theory

End-to-end joint optimization of metasurface and image processing for compact snapshot hyperspectral imaging

Fast Multispectral Imaging by Spatial Pixel-Binning and Spectral Unmixing

Snapshot compressed sensing computed-tomography imaging spectrometry

Snapshot computational spectroscopy enabled by deep learning

Single-shot three-dimensional imaging with a metasurface depth camera

Spectral-depth imaging with deep learning based reconstruction.

Aperture Diffraction for Compact Snapshot Spectral Imaging

Snapshot Hyperspectral Imaging Via Spectral Basis Multiplexing in Fourier Domain

Snapshot Compressive ToF+Spectral Imaging via Optimized Color-Coded Apertures

Snapshot Imaging Spectrometer Based on Pixel-Level Filter Array (PFA)