Abstract:Depth cameras are emerging as a cornerstone modality with diverse applications that directly or indirectly rely on measured depth, including personal devices, robotics, and self-driving vehicles. Although time-of-flight (ToF) methods have fueled these applications, the precision and robustness of ToF methods is limited by relying on photon time-tagging or modulation after photo-conversion. Successful optical modulation approaches have been restricted fiber-coupled modulation with large coupling losses or interferometric modulation with sub-cm range, and the precision gap between interferometric methods and ToF methods is more than three orders of magnitudes. In this work, we close this gap and propose a computational imaging method for all-optical free-space correlation before photo-conversion that achieves micron-scale depth resolution with robustness to surface reflectance and ambient light with conventional silicon intensity sensors. To this end, we solve two technical challenges: modulating at GHz rates and computational phase unwrapping. We propose an imaging approach with resonant polarization modulators and devise a novel optical dual-pass frequency-doubling which achieves high modulation contrast at more than 10GHz. At the same time, centimeter-wave modulation together with a small modulation bandwidth render existing phase unwrapping methods ineffective. We tackle this problem with a neural phase unwrapping method that exploits that adjacent wraps are often highly correlated. We validate the proposed method in simulation and experimentally, where it achieves micron-scale depth precision. We demonstrate precise depth sensing independently of surface texture and ambient light and compare against existing analog demodulation methods, which we outperform across all tested scenarios.

A Configurable and Real-Time Multi-Frequency 3D Image Signal Processor for Indirect Time-of-Flight Sensors

An Energy-Efficient Dynamic Feedback Image Signal Processor for Three-Dimensional Time-of-Flight Sensors

Infrared Small Target Tracking Based on Sopc

Simultaneous Multifrequency Demodulation for Single-Shot Multiple-Path ToF Imaging

Lightweight and Real-Time Infrared Image Processor Based on FPGA

High-Speed Optical 3D Measurement Sensor for Industrial Application

Exploiting wavelength diversity for high resolution time-of-flight 3D imaging

Simd Massively Parallel Processing System For Real-Time Image Processing

Full High-Definition Real-Time Depth Estimation for Three-Dimensional Video System

A wide-spectrum and high-speed CMOS system based on FPGA

Full Hd Real-Time Depth Estimation Algorithm and Hardware Implementation

Research of Fast 3d Imaging Based on Multiple Mode

Itof-Flow-based High Frame Rate Depth Imaging

A Tightly Coupled AI-ISP Vision Processor

Towards Zero-power 3D Imaging: VLC-assisted Passive ToF Sensing

Design of Large-Array CMOS Real-Time Imaging System Based on FPGA

A Manycore Vision Processor for Real-Time Smart Cameras

Centimeter-Wave Free-Space Time-of-Flight Imaging

Design of high-speed real-time sensor image processing based on FPGA and DDR3

Efficient smart CMOS camera based on FPGAs oriented to embedded image processing

High-performance architecture for real-time high-definition short-wave infrared streaming video processing and its field programmable gate array prototype