Abstract:Three-dimensional (3D) reconstruction of dynamic objects has broad applications, including object recognition and robotic manipulation. However, achieving high-accuracy reconstruction and robustness to motion simultaneously is a challenging task. In this paper, we present a novel method for 3D reconstruction of dynamic objectS, whose main features are as follows. Firstly, a structured-light multiplexing method is developed that only requires 3 patterns to achieve high-accuracy encoding. Fewer projected patterns require shorter image acquisition time, thus, the object motion is reduced in each reconstruction cycle. The three patterns, i.e. spatial-temporally encoded patterns, are generated by embedding a specifically designed spatial-coded texture map into the temporal-encoded three-step phase-shifting fringes. A temporal codeword and three spatial codewords are extracted from the composite patterns using a proposed extraction algorithm. The two types of codewords are utilized separately in stereo matching: the temporal codeword ensures the high accuracy, while the spatial codewords are responsible for removing phase ambiguity. Secondly, we aim to eliminate the reconstruction error induced by motion between frames abbreviated as motion induced error (MiE). Instead of assuming the object to be static when acquiring the 3 images, we derive the motion of projection pixels among frames. Using the extracted spatial codewords, correspondences between different frames are found, i.e. pixels with the same codewords are traceable in the image sequences. Therefore, we can obtain the phase map at each image-acquisition moment without being affected by the object motion. Then the object surfaces corresponding to all the images can be recovered. Experimental results validate the high reconstruction accuracy and precision of the proposed method for dynamic objects with different motion speeds. Comparative experiments show that the presented method demonstrates superior performanc- with various types of motion, including translation in different directions and deformation.

Three-dimensional reconstruction of moving HDR object based on PSP

3D Object Reconstruction Algorithm Based on Dynamic Threshold Dithering Technique

Real-time Motion-Induced Error Reduction for Phase-Shifting Profilometry with Projection Points Tracking Method

High-Dynamic-Range 3-D Shape Measurement With Adaptive Speckle Projection Through Segmentation-Based Mapping

3D shape measurement method for multi-reflective scenes based on accurate pixel-by-pixel phase-error adjustment strategy

An Efficient High Dynamic Range 3D Shape Reconstruction Method Based on Double Phase-Shifting Profilometry

A novel approach to obtain optimal exposure for 3D shape reconstruction of high dynamic range objects

Efficient and robust 3D reconstruction: Absolute phase extraction algorithm based on three gray images

A multi-task learning-based approach for single-projection HDR 3D reconstruction

High dynamic range 3D measurements based on space-time speckle correlation and color camera

High dynamic range 3D measurement based on polarization and multispectrum co-modulation

Synthesize-Then-Evaluate Based Optimal Exposures Selection for High Dynamic Range Fringe Projection Profilometry

HDR Video Reconstruction with Tri-Exposure Quad-Bayer Sensors

Pixel-wise Phase Map Fusion Technique for High Dynamic Range 3-D Shape Measurement

An investigation of high dynamic range imaging of highly reflective surfaces based on deep learning 3D fringe projection

Texture and Exposure Awareness Based Refill for HDRI Reconstruction of Saturated and Occluded Areas

Outdoor Scene 3D Reconstruction from Multiple Point Cloud

High Dynamic Range Scanning Technique

High-speed high dynamic range 3D shape measurement based on deep learning

Accurate 3D Reconstruction of Dynamic Objects by Spatial-Temporal Multiplexing and Motion-Induced Error Elimination