Abstract:Time-of-flight (ToF) sensors provide an imaging modality fueling diverse applications, including LiDAR in autonomous driving, robotics, and augmented reality. Conventional ToF imaging methods estimate the depth by sending pulses of light into a scene and measuring the ToF of the first-arriving photons directly reflected from a scene surface without any temporal delay. As such, all photons following this first response are typically considered as unwanted noise. In this paper, we depart from the principle of using first-arriving photons and propose an all-photon ToF imaging method by incorporating the temporal-polarimetric analysis of first- and late-arriving photons, which possess rich scene information about its geometry and material. To this end, we propose a novel temporal-polarimetric reflectance model, an efficient capture method, and a reconstruction method that exploits the temporal-polarimetric changes of light reflected by the surface and sub-surface reflection. The proposed all-photon polarimetric ToF imaging method allows for acquiring depth, surface normals, and material parameters of a scene by utilizing all photons captured by the system, whereas conventional ToF imaging only obtains coarse depth from the first-arriving photons. We validate our method in simulation and experimentally with a prototype.
What problem does this paper attempt to address?
The problem that this paper attempts to solve is that the existing Time - of - Flight (ToF) imaging techniques only use the first - arriving photons to estimate the scene depth, while ignoring the rich geometric and material information contained in the subsequently arriving photons. These subsequently arriving photons, especially those re - reflected after subsurface scattering on the object surface, carry important information about the material properties and internal structure of the object. Traditional methods regard these photons as noise, resulting in a great waste of useful information.
To solve this problem, the paper proposes a brand - new all - photon polarimetric ToF imaging method. This method not only uses the first - arriving photons, but also extracts the depth, surface normal, and material parameters of the scene by analyzing the time - polarization characteristics of the first - arriving and delayed - arriving photons. Specifically, the main contributions of the paper include:
1. **All - photon polarimetric ToF imaging method**: Combine ToF imaging and polarization analysis, and jointly use surface and subsurface reflected photons to reconstruct the scene.
2. **Time - polarization Bidirectional Reflectance Distribution Function (BRDF) model**: For the first time, propose a BRDF model that describes the time - polarization characteristics of surface and subsurface reflections.
3. **Efficient time - polarization acquisition method**: Propose an efficient acquisition method for capturing the time - polarization signals of the scene, combined with the learned optical ellipsometry technique.
4. **Experimental verification**: Verify the effectiveness of this method in simulations and experiments, and be able to record the depth, normal, and material parameters of the scene from time - polarization measurements.
Through these innovations, this method can extract and utilize scene information in a wider range, thereby improving the accuracy and application range of ToF imaging.