Abstract:Depth cameras are emerging as a cornerstone modality with diverse applications that directly or indirectly rely on measured depth, including personal devices, robotics, and self-driving vehicles. Although time-of-flight (ToF) methods have fueled these applications, the precision and robustness of ToF methods is limited by relying on photon time-tagging or modulation after photo-conversion. Successful optical modulation approaches have been restricted fiber-coupled modulation with large coupling losses or interferometric modulation with sub-cm range, and the precision gap between interferometric methods and ToF methods is more than three orders of magnitudes. In this work, we close this gap and propose a computational imaging method for all-optical free-space correlation before photo-conversion that achieves micron-scale depth resolution with robustness to surface reflectance and ambient light with conventional silicon intensity sensors. To this end, we solve two technical challenges: modulating at GHz rates and computational phase unwrapping. We propose an imaging approach with resonant polarization modulators and devise a novel optical dual-pass frequency-doubling which achieves high modulation contrast at more than 10GHz. At the same time, centimeter-wave modulation together with a small modulation bandwidth render existing phase unwrapping methods ineffective. We tackle this problem with a neural phase unwrapping method that exploits that adjacent wraps are often highly correlated. We validate the proposed method in simulation and experimentally, where it achieves micron-scale depth precision. We demonstrate precise depth sensing independently of surface texture and ambient light and compare against existing analog demodulation methods, which we outperform across all tested scenarios.

Time-of-Flight (ToF) Cameras for Underwater Situational Awareness

Investigating the Rate of Turbidity Impact on Underwater Spectral Reflectance Detection

An Open-Source Platform For Underwater Image And Video Analytics

An Overview of Depth Cameras and Range Scanners Based on Time-of-Flight Technologies

Simultaneous Estimation of Object Region and Depth in Participating Media Using a ToF Camera

K-nearest Neighborhood Based Integration of Time-of-flight Cameras and Passive Stereo for High-Accuracy Depth Maps.

Time-of-flight based imaging in strong scattering underwater environments

Visual Detection And Feature Recognition Of Underwater Target Using A Novel Model-Based Method

DELTAR: Depth Estimation from a Light-Weight ToF Sensor and RGB Image

Computational imaging with multi-camera time-of-flight systems

Iterative Error Removal for Time-of-Flight Depth Imaging

Single-shot ToF sensing with sub-mm precision using conventional CMOS sensors

Centimeter-Wave Free-Space Time-of-Flight Imaging

Exploiting wavelength diversity for high resolution time-of-flight 3D imaging

TOF-assisted binocular vision accuracy improvement method for underwater fish size inspection

Commercial Optical and Acoustic Sensor Performances under Varying Turbidity, Illumination, and Target Distances

Underwater depth imaging using time-correlated single-photon counting

Real-Time Visualization System for Deep-Sea Surveying

All-photon Polarimetric Time-of-Flight Imaging

Low Power Depth Estimation of Rigid Objects for Time-of-Flight Imaging

Underwater Optical Imaging: Methods, Applications and Perspectives