Abstract:Depth cameras are emerging as a cornerstone modality with diverse applications that directly or indirectly rely on measured depth, including personal devices, robotics, and self-driving vehicles. Although time-of-flight (ToF) methods have fueled these applications, the precision and robustness of ToF methods is limited by relying on photon time-tagging or modulation after photo-conversion. Successful optical modulation approaches have been restricted fiber-coupled modulation with large coupling losses or interferometric modulation with sub-cm range, and the precision gap between interferometric methods and ToF methods is more than three orders of magnitudes. In this work, we close this gap and propose a computational imaging method for all-optical free-space correlation before photo-conversion that achieves micron-scale depth resolution with robustness to surface reflectance and ambient light with conventional silicon intensity sensors. To this end, we solve two technical challenges: modulating at GHz rates and computational phase unwrapping. We propose an imaging approach with resonant polarization modulators and devise a novel optical dual-pass frequency-doubling which achieves high modulation contrast at more than 10GHz. At the same time, centimeter-wave modulation together with a small modulation bandwidth render existing phase unwrapping methods ineffective. We tackle this problem with a neural phase unwrapping method that exploits that adjacent wraps are often highly correlated. We validate the proposed method in simulation and experimentally, where it achieves micron-scale depth precision. We demonstrate precise depth sensing independently of surface texture and ambient light and compare against existing analog demodulation methods, which we outperform across all tested scenarios.

Computational Multi-Depth Single-Photon Imaging

Single-Photon Depth Imaging Using a Union-of-Subspaces Model

Photon-Efficient Computational 3D and Reflectivity Imaging with Single-Photon Detectors

Multi-image-distance Imaging System for Extending Depth-of-field

Photon-efficient Computational Imaging with a Single-Photon Camera

Computational Depth Imaging Using the Fast Deconvolution Method

Single picture single photon single pixel 3D imaging through unknown thick scattering medium

Multi-slice Ptychographic Imaging with Multistage Coarse-to-fine Reconstruction

Adaptive Depth Imaging with Single-Photon Detectors

Approach for Pseudo-random Bit-Stream Multi-Depth Imaging

Deep Learning Based Single-Photon 3D Imaging with Multiple Returns

Single-photon 3D imaging with deep sensor fusion

Adaptive Compressed Photon Counting 3D Imaging Based on Wavelet Trees and Depth Map Sparse Representation.

Single photon imaging based on a photon driven sparse sampling

First-photon imaging with independent depth reconstruction

Adaptive compressed 3D imaging based on wavelet trees and Hadamard multiplexing with a single photon counting detector

Enhance imaging depth in wide-field two-photon microscopy by extended detection and computational reconstruction

Centimeter-Wave Free-Space Time-of-Flight Imaging

A Depth Image Reconstruction Algorithm Based on Background Noise Censoring

Optimal compressive multiphoton imaging at depth using single-pixel detection

Deep-learning-based Single-Photon-counting Compressive Imaging Via Jointly Trained Subpixel Convolution Sampling.