Abstract:In recent years, computational Time-of-Flight (ToF) imaging has emerged as an exciting and a novel imaging modality that offers new and powerful interpretations of natural scenes, with applications extending to 3D, light-in-flight, and non-line-of-sight imaging. Mathematically, ToF imaging relies on algorithmic super-resolution, as the back-scattered sparse light echoes lie on a finer time resolution than what digital devices can capture. Traditional methods necessitate knowledge of the emitted light pulses or kernels and employ sparse deconvolution to recover scenes. Unlike previous approaches, this paper introduces a novel, blind ToF imaging technique that does not require kernel calibration and recovers sparse spikes on a continuum, rather than a discrete grid. By studying the shared characteristics of various ToF modalities, we capitalize on the fact that most physical pulses approximately satisfy the Strang-Fix conditions from approximation theory. This leads to a new mathematical formulation for sparse super-resolution. Our recovery approach uses an optimization method that is pivoted on an alternating minimization strategy. We benchmark our blind ToF method against traditional kernel calibration methods, which serve as the baseline. Extensive hardware experiments across different ToF modalities demonstrate the algorithmic advantages, flexibility and empirical robustness of our approach. We show that our work facilitates super-resolution in scenarios where distinguishing between closely spaced objects is challenging, while maintaining performance comparable to known kernel situations. Examples of light-in-flight imaging and light-sweep videos highlight the practical benefits of our blind super-resolution method in enhancing the understanding of natural scenes.

Resolving Transient Time Profile in ToF Imaging Via Log-Sum Sparse Regularization.

Fourier Analysis on Transient Imaging with a Multifrequency Time-of-Flight Camera

Model Study of Transient Imaging With Multi-Frequency Time-of-Flight Sensors

Frequency-Domain Transient Imaging

Transient Imaging with a Time-of-flight Camera and Its Applications

Non-line-of-sight transient imaging via using time-of-flight camera

Blind Time-of-Flight Imaging: Sparse Deconvolution on the Continuum with Unknown Kernels

Deep Learning for Transient Image Reconstruction from ToF Data

Explore Spatial-Temporal Relations: Transient Super-Resolution with PMD Sensors

Robust And Accurate Transient Light Transport Decomposition Via Convolutional Sparse Coding

All-photon Polarimetric Time-of-Flight Imaging

Simultaneous Multifrequency Demodulation for Single-Shot Multiple-Path ToF Imaging

Enhancing the spatial resolution of time-of-flight based non-line-of-sight imaging via instrument response function deconvolution

Role of Transients in Two-Bounce Non-Line-of-Sight Imaging

High Resolution, Deep Imaging Using Confocal Time-of-flight Diffuse Optical Tomography

Non-invasive multispectral scattering imaging via OTF retrieval

Temporal frequency probing for 5D transient analysis of global light transport

Overcoming photon and spatiotemporal sparsity in fluorescence lifetime imaging with SparseFLIM

Towards Zero-power 3D Imaging: VLC-assisted Passive ToF Sensing

Am Ultrasound-Modulated Optical Tomography with Real-Time Fft

Real-time Scan-Free Non-Line-of-sight Imaging