Snapshot Interferometric 3D Imaging by Compressive Sensing and Deep Learning

Mu Qiao,Yangyang Sun,Jiawei Ma,Ziyi Meng,Xuan Liu,Xin Yuan
DOI: https://doi.org/10.48550/arXiv.2004.02633
2020-04-03
Image and Video Processing
Abstract:We demonstrate single-shot compressive three-dimensional (3D) $(x, y, z)$ imaging based on interference coding. The depth dimension of the object is encoded into the interferometric spectra of the light field, resulting a $(x, y, \lambda)$ datacube which is subsequently measured by a single-shot spectrometer. By implementing a compression ratio up to $400$, we are able to reconstruct $1G$ voxels from a 2D measurement. Both an optimization based compressive sensing algorithm and a deep learning network are developed for 3D reconstruction from a single 2D coded measurement. Due to the fast acquisition speed, our approach is able to capture volumetric activities at native camera frame rates, enabling 4D (volumetric-temporal) visualization of dynamic scenes.
What problem does this paper attempt to address?