Abstract:Depth cameras are emerging as a cornerstone modality with diverse applications that directly or indirectly rely on measured depth, including personal devices, robotics, and self-driving vehicles. Although time-of-flight (ToF) methods have fueled these applications, the precision and robustness of ToF methods is limited by relying on photon time-tagging or modulation after photo-conversion. Successful optical modulation approaches have been restricted fiber-coupled modulation with large coupling losses or interferometric modulation with sub-cm range, and the precision gap between interferometric methods and ToF methods is more than three orders of magnitudes. In this work, we close this gap and propose a computational imaging method for all-optical free-space correlation before photo-conversion that achieves micron-scale depth resolution with robustness to surface reflectance and ambient light with conventional silicon intensity sensors. To this end, we solve two technical challenges: modulating at GHz rates and computational phase unwrapping. We propose an imaging approach with resonant polarization modulators and devise a novel optical dual-pass frequency-doubling which achieves high modulation contrast at more than 10GHz. At the same time, centimeter-wave modulation together with a small modulation bandwidth render existing phase unwrapping methods ineffective. We tackle this problem with a neural phase unwrapping method that exploits that adjacent wraps are often highly correlated. We validate the proposed method in simulation and experimentally, where it achieves micron-scale depth precision. We demonstrate precise depth sensing independently of surface texture and ambient light and compare against existing analog demodulation methods, which we outperform across all tested scenarios.

Computational Depth Sensing : Toward high-performance commodity depth cameras.

DoCam: Depth Sensing with an Optical Image Stabilization Supported RGB Camera.

Calibration-free Deep Optics for Depth Estimation with Precise Simulation

Multi-image-distance Imaging System for Extending Depth-of-field

Reliable Fusion of ToF and Stereo Data Based on Joint Depth Filter

High quality depth maps from stereo matching and ToF camera.

Research progress of depth detection in vision measurement: A novel project of bifocal imaging system for 3D measurement

Depth map enhancement based on color and depth consistency

Theory and implementation of depth photography

K-nearest Neighborhood Based Integration of Time-of-flight Cameras and Passive Stereo for High-Accuracy Depth Maps.

DELTAR: Depth Estimation from a Light-Weight ToF Sensor and RGB Image

TOF Depth Map Super-resolution Using Compressive Sensing

Depth from Coupled Optical Differentiation

DCDepth: Progressive Monocular Depth Estimation in Discrete Cosine Domain

Depth Sensing Beyond LiDAR Range

Centimeter-Wave Free-Space Time-of-Flight Imaging

AutoDepthNet: High Frame Rate Depth Map Reconstruction using Commodity Depth and RGB Cameras

Survey of 3D Modeling Using Depth Cameras.

Depth from Defocus in the Wild.

Enhanced Depth Estimation for Hand-Held Light Field Cameras

Extending the depth of field of imaging systems using depth sensing camera