Abstract:Transient imaging provides a direct view of how light travel in the scene, which leads to exciting applications such as looking around corners. Low-budget transient imagers, adapted from Time-of-Fight (ToF) cameras, reduce the barrier of entry for performing research of this new imaging modality. However, the image quality is far from satisfactory due to the limited resolution of PMD sensors. In this paper, we improve the resolution of transient images by modulating the illumination. We capture the scene under three linearly independent lighting conditions, and derive a theoretical model for the relationship between the time-profile and the corresponding 3D details of each pixel. Our key idea is that the light flight time in each pixel patch is proportional to the cross product of the illuminating direction and the surface normal. First we capture and reconstruct transient images by Fourier analysis at multiple illumination locations, and then fuse the data of acquired low-spatial resolution images to calculate the surface normal. Afterwards, we use an optimization procedure to split the pixels and finally enhance the image quality. We show that we can not only reveal the fine structure of the object but may also uncover the reflectance properties of different materials. We hope the idea of utilizing spatial-temporal relations will give new insights to the research and applications of transient imaging.

Model Study of Transient Imaging With Multi-Frequency Time-of-Flight Sensors

Transient Imaging with a Time-of-flight Camera and Its Applications

Frequency-Domain Transient Imaging

Fourier Analysis on Transient Imaging with a Multifrequency Time-of-Flight Camera

Non-line-of-sight transient imaging via using time-of-flight camera

Explore Spatial-Temporal Relations: Transient Super-Resolution with PMD Sensors

Resolving Transient Time Profile in ToF Imaging Via Log-Sum Sparse Regularization.

Frequency Analysis of Transient Light Transport with Applications in Bare Sensor Imaging

Recent advances in transient imaging: A computer graphics and vision perspective

Temporal frequency probing for 5D transient analysis of global light transport

Ultrafast light field tomography for snapshot transient and non-line-of-sight imaging

Real-time Scan-Free Non-Line-of-sight Imaging

Simultaneous Multifrequency Demodulation for Single-Shot Multiple-Path ToF Imaging

All-photon Polarimetric Time-of-Flight Imaging

Transient Imaging Based on Pump-Probe Technique: Advances and Prospects

Computational imaging with multi-camera time-of-flight systems

High-speed object detection with a single-photon time-of-flight image sensor

Time-resolved multiple imaging by detecting photons with changeable wavelengths

Temporal Imaging for Ultrafast Spectral-Temporal Optical Signal Processing and Characterization

Time-of-flight based imaging in strong scattering underwater environments

Asynchronous wide-field transient absorption microscopy