Abstract:Three-dimensional (3D) reconstruction of dynamic objects has broad applications, including object recognition and robotic manipulation. However, achieving high-accuracy reconstruction and robustness to motion simultaneously is a challenging task. In this paper, we present a novel method for 3D reconstruction of dynamic objectS, whose main features are as follows. Firstly, a structured-light multiplexing method is developed that only requires 3 patterns to achieve high-accuracy encoding. Fewer projected patterns require shorter image acquisition time, thus, the object motion is reduced in each reconstruction cycle. The three patterns, i.e. spatial-temporally encoded patterns, are generated by embedding a specifically designed spatial-coded texture map into the temporal-encoded three-step phase-shifting fringes. A temporal codeword and three spatial codewords are extracted from the composite patterns using a proposed extraction algorithm. The two types of codewords are utilized separately in stereo matching: the temporal codeword ensures the high accuracy, while the spatial codewords are responsible for removing phase ambiguity. Secondly, we aim to eliminate the reconstruction error induced by motion between frames abbreviated as motion induced error (MiE). Instead of assuming the object to be static when acquiring the 3 images, we derive the motion of projection pixels among frames. Using the extracted spatial codewords, correspondences between different frames are found, i.e. pixels with the same codewords are traceable in the image sequences. Therefore, we can obtain the phase map at each image-acquisition moment without being affected by the object motion. Then the object surfaces corresponding to all the images can be recovered. Experimental results validate the high reconstruction accuracy and precision of the proposed method for dynamic objects with different motion speeds. Comparative experiments show that the presented method demonstrates superior performanc- with various types of motion, including translation in different directions and deformation.

Feature-Assisted Dense Spatio-Temporal Reconstruction From Binocular Sequences

Motion-Based Temporal Alignment of Independently Moving Cameras

Spatio-Temporal Depth Recovery of Dynamic Scenes with Multiple Handheld Cameras

3d Reconstruction Of Dynamic Scenes With Multiple Handheld Cameras

Temporally Coherent General Dynamic Scene Reconstruction

Robust 3D Reconstruction with an RGB-D Camera

Temporally Coherent 4D Reconstruction of Complex Dynamic Scenes

Relative Epipolar Motion of Tracked Features for Correspondence in Binocular Stereo

CRF-Based Reconstruction from Narrow-Baseline Image Sequences.

Shape of Motion: 4D Reconstruction from a Single Video

Temporal-Dense Dynamic 3-D Reconstruction With Low Frame Rate Cameras.

Accurate 3D Reconstruction of Dynamic Objects by Spatial-Temporal Multiplexing and Motion-Induced Error Elimination

Dynamic 3D Surface Reconstruction Using a Hand-Held Camera

Monocular Dense 3D Reconstruction of a Complex Dynamic Scene from Two Perspective Frames

Real-time Dense Reconstruction of Tissue Surface from Stereo Optical Video

Incremental Dense Reconstruction from Monocular Video with Guided Sparse Feature Volume Fusion

A Sfm-Based Sparse To Dense 3d Face Reconstruction Method Robust To Feature Tracking Errors

Monocular three dimensional dense surface reconstruction by optical flow feedback

Real-time 3D Scene Reconstruction with Dynamically Moving Object Using a Single Depth Camera

Semi-Dense 3D Reconstruction with a Stereo Event Camera