Abstract:Structured light (SL) based three-dimensional (3D) measurement struggles to estimate high dynamic range (HDR) scenes, where both high and low reflectivity parts exist simultaneously. This paper proposes a method through the joint design and optimization of hardware and algorithms, in which only four frames are required to realize the 3D reconstruction of HDR scenes. The height information of each sub-area in the scene under test can be encoded effectively by temporally projecting two sets of complementary speckle patterns onto target surface. To decode the corresponding patterns captured by the cameras, we design a stereo matching strategy consisting of space-time binary feature (ST-BIF) descriptor preliminary screening and zero-mean normalized cross-correlation (ST-ZNCC) final retrieval. The ST-BIF descriptor based on neighborhood comparison is designed to describe the space-time relative intensity change of projected speckles. Besides the HDR adaptability, the ST-BIF descriptor can effectively improve the matching speed. In addition, the measurable dynamic range can be further improved by fusing all channel disparities as evaluated results, benefitting from the different response of R, G and B channels in color camera to monochromatic light. Experiments are conducted to demonstrate the feasibility of the proposed method. The results indicate that our method achieves the root mean square error 0.2516mm (vs. 1.0668 by commonly used ZNCC) and an average coverage rate up to 94.87% (vs. 93.35% by commonly used ZNCC). Furthermore, the experimental results show that the proposed method can achieve 3D reconstruction of HDR scenes including specular reflection region.

Calibrating lighting simulation with panoramic high dynamic range imaging

Calibrating Light Sources by Using a Planar Mirror.

A 360-Degree Panoramic Stereo Scanning Measurement System Based on a Panoramic Annular Lens and Omnidirectional Ring Structured Light

Improving the accuracy of circadian lighting simulation with field measurement

An automatic calibration algorithm for endoscopic structured light sensors in cylindrical environment

Calibration of a Camera-Array-based Microscopic System with Spatiotemporal Structured Light Encoding

Case studies of a camera-aided imaging method for evaluation of interior luminous environments

Evaluating Panoramic 3D Estimation in Indoor Lighting Analysis

From Faces to Outdoor Light Probes

Lighting Deviation Correction for Integrating-Sphere Multispectral Imaging Systems.

Learning HDR illumination from LDR panorama images

Automatic Calibration Between Multi-Lines LiDAR and Visible Light Camera Based on Edge Refinement and Virtual Mask Matching

High dynamic range 3D measurements based on space-time speckle correlation and color camera

Deep Lighting Environment Map Estimation from Spherical Panoramas

Adaptive Light Estimation using Dynamic Filtering for Diverse Lighting Conditions

Virtual home staging and relighting from a single panorama under natural illumination

Utilizing a Terrestrial Laser Scanner for 3D Luminance Measurement of Indoor Environments

Light Pose Calibration for Camera-light Vision Systems

Spatiotemporally Consistent HDR Indoor Lighting Estimation

CCD Irradiance Calibration Algorithm for HDR Image Acquisition

Calibration of a structure light based windshield inspection system