Abstract:Depth cameras are emerging as a cornerstone modality with diverse applications that directly or indirectly rely on measured depth, including personal devices, robotics, and self-driving vehicles. Although time-of-flight (ToF) methods have fueled these applications, the precision and robustness of ToF methods is limited by relying on photon time-tagging or modulation after photo-conversion. Successful optical modulation approaches have been restricted fiber-coupled modulation with large coupling losses or interferometric modulation with sub-cm range, and the precision gap between interferometric methods and ToF methods is more than three orders of magnitudes. In this work, we close this gap and propose a computational imaging method for all-optical free-space correlation before photo-conversion that achieves micron-scale depth resolution with robustness to surface reflectance and ambient light with conventional silicon intensity sensors. To this end, we solve two technical challenges: modulating at GHz rates and computational phase unwrapping. We propose an imaging approach with resonant polarization modulators and devise a novel optical dual-pass frequency-doubling which achieves high modulation contrast at more than 10GHz. At the same time, centimeter-wave modulation together with a small modulation bandwidth render existing phase unwrapping methods ineffective. We tackle this problem with a neural phase unwrapping method that exploits that adjacent wraps are often highly correlated. We validate the proposed method in simulation and experimentally, where it achieves micron-scale depth precision. We demonstrate precise depth sensing independently of surface texture and ambient light and compare against existing analog demodulation methods, which we outperform across all tested scenarios.

A Novel Imaging Method for Two-Tap Pulsed-Based Indirect Time-of-Flight Sensor

Polarisation-modulated Photon-Counting 3D Imaging Based on a Negative Parabolic Pulse Model

Data Processing Method of Time-of-flight 3D Imaging Camera

Pulsed Light Time-of-flight Measurement Based on a Differential Hysteresis Timing Discrimination Method.

Simultaneous Multifrequency Demodulation for Single-Shot Multiple-Path ToF Imaging

A low-power DTOF image sensor with double-frame-multiplexing mode for long-range detection

A Two-Tap Indirect Time-of-Flight CMOS Image Sensor With Pump Gate Modulator for Low-Power Applications

Compact Numerical Modeling of Indirect Time-of-Flight CMOS Image Sensors

A 320x240 I-ToF CMOS Image Sensor with 2-Tap 5.6m Pixel and Mismatch-Nonlinearity Suppression

Physics-Based TOF Imaging Simulation for Space Targets Based on Improved Path Tracing

An 8-Tap CMOS Lock-In Pixel Image Sensor for Short-Pulse Time-of-Flight Measurements

Non-line-of-sight transient imaging via using time-of-flight camera

Miniaturized time-correlated single-photon counting module for time-of-flight non-line-of-sight imaging applications

The Calibration Method for Incomplete Charge Transfer in ToF Image Sensor

Real-Time Artifact Compensation for Depth Images of Multi-Frequency ToF

Optimized Design Of A Led-Array-Based Tof Range Imaging Sensor For Fast 3-D Shape Measurement

Pseudo-Random Spread Spectrum Technique Based Single-Pixel Imaging Method

A CMOS Time-of-Flight Image Sensor with High Dynamic Range Digital Pixel

All-photon Polarimetric Time-of-Flight Imaging

Time-of-flight range imaging using group testing

Centimeter-Wave Free-Space Time-of-Flight Imaging