Abstract:We present an efficient and robust photometric stereo (PS) measurement by a setup with an optical diffuser. The setup which includes a single projector that places point light sources on the diffuser, extends the possibility of flexible measurement without the limitation from employing physical light sources, i.e. a number and illumination shape. By taking advantage of the setup, we design an illumination for effective and robust surface normal estimation. Unlike the previous techniques, we utilize deep neural network consists of a renderer and a PS module to find multiplexed illumination patterns, which are suitable for PS measurement. Another challenging problem is to measure objects with micro-structures which reflect the light randomly according to lighting and viewing directions. To overcome the problem, we propose a novel PS measurement using a dual-photography setup, which allows us to analyze the angular distribution of reflection by capturing reflection pattern on the diffuser. We show a smooth surface normal can be estimated by simply applying a low-pass filter on the captured images. Moreover, we also propose an effective sampling to deal with time-consuming measurement of dual photography setup. We show that by utilization of the trained sampling codes by DNN considering light transport in the setup, the number of the measurement is drastically reduced.

Time-Resolved Far Infrared Light Transport Decomposition for Thermal Photometric Stereo

Multi-sensor Spatial Augmented Reality for Visualizing the Invisible Thermal Information of 3D Objects

Decomposing Global Light Transport Using Time of Flight Imaging

Depth and Thermal Sensor Fusion to Enhance 3D Thermographic Reconstruction

Robust And Accurate Transient Light Transport Decomposition Via Convolutional Sparse Coding

On-the-fly Extrinsic Calibration of Multimodal Sensing System for Fast 3D Thermographic Scanning

Temporal frequency probing for 5D transient analysis of global light transport

Event-ID: Intrinsic Decomposition Using an Event Camera

Three-dimensional Simultaneous Measurements of Micro-Fluorescent-particle Position and Temperature Field Via Digital Hologram

Simultaneous Estimation of Object Region and Depth in Participating Media Using a ToF Camera

Defogging Kinect: Simultaneous Estimation of Object Region and Depth in Foggy Scenes

Depth Thermography: Noninvasive 3D Temperature Profiling Using Infrared Thermal Emission

Depth thermography: non-invasive 3D temperature profiling using infrared thermal emission

Differentiable Dynamic Visible-Light Tomography.

Fourier Analysis on Transient Imaging with a Multifrequency Time-of-Flight Camera

Efficient light transport acquisition by coded illumination and robust photometric stereo by dual photography using deep neural network

Combining modern 3D reconstruction and thermal imaging: generation of large-scale 3D thermograms in real-time

Sub-diffraction thermoreflectance thermal imaging using image reconstruction

Transparent Object Reconstruction via Coded Transport of Intensity

Four-dimensional laser absorption cinematography of species and temperature dynamics at 2 kHz in reacting flows

Frequency Analysis of Transient Light Transport with Applications in Bare Sensor Imaging